-- Logs begin at Fri 2022-10-14 12:21:45 UTC, end at Fri 2022-10-14 13:21:06 UTC. -- Oct 14 12:51:05.757164 dv-cinder-820994-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 14 12:51:05.765055 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 14 12:51:05.768234 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 14 12:51:05 2022] *** Oct 14 12:51:05.768234 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 14 12:51:05.768234 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 14 12:51:05.768234 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: nodename: dv-cinder-820994-7-iscsi Oct 14 12:51:05.768234 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: machine: x86_64 Oct 14 12:51:05.768234 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: clock source: unix Oct 14 12:51:05.768234 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: pcre jit disabled Oct 14 12:51:05.768234 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: detected number of CPU cores: 4 Oct 14 12:51:05.768234 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: current working directory: / Oct 14 12:51:05.768234 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: detected binary path: /usr/bin/uwsgi-core Oct 14 12:51:05.768234 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: your processes number limit is 47680 Oct 14 12:51:05.768234 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: your memory page size is 4096 bytes Oct 14 12:51:05.768234 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: detected max file descriptor number: 2048 Oct 14 12:51:05.768234 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: lock engine: pthread robust mutexes Oct 14 12:51:05.769095 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: thunder lock: enabled Oct 14 12:51:05.769095 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 14 12:51:05.769095 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 14 12:51:05.807082 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: Python main interpreter initialized at 0x55b34d5839c0 Oct 14 12:51:05.807082 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: python threads support enabled Oct 14 12:51:05.807082 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: your server socket listen backlog is limited to 100 connections Oct 14 12:51:05.807082 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: your mercy for graceful operations on workers is 90 seconds Oct 14 12:51:05.807529 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: mapped 403077 bytes (393 KB) for 2 cores Oct 14 12:51:05.807529 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: *** Operational MODE: preforking *** Oct 14 12:51:05.807766 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: *** uWSGI is running in multiple interpreter mode *** Oct 14 12:51:05.807766 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: spawned uWSGI master process (pid: 103666) Oct 14 12:51:05.807956 dv-cinder-820994-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 14 12:51:05.809514 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: spawned uWSGI worker 1 (pid: 103667, cores: 1) Oct 14 12:51:05.809514 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: spawned uWSGI worker 2 (pid: 103668, cores: 1) Oct 14 12:51:05.809514 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 14 12:51:06.461071 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 12:51:06.462052 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 12:51:07.534517 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:51:07.534517 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: from cryptography.utils import int_from_bytes Oct 14 12:51:07.535149 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:51:07.535149 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: from cryptography.utils import int_from_bytes Oct 14 12:51:07.537531 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:51:07.537531 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: from cryptography.utils import int_from_bytes Oct 14 12:51:07.537949 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:51:07.537949 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: from cryptography.utils import int_from_bytes Oct 14 12:51:10.001637 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 12:51:10.002110 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 12:51:10.002314 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 12:51:10.002661 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 12:51:10.002746 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 12:51:10.002844 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 12:51:10.002990 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 12:51:10.003086 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 12:51:10.003367 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.003461 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 12:51:10.003676 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 12:51:10.003778 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.003994 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.004082 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.004312 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.004401 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.004638 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.004736 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.004951 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.005056 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.005267 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.005379 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.005600 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.005691 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.005921 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.006008 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.006175 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.006270 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.006486 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.006572 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.006785 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.006876 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-7-iscsi {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.007099 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.007196 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.007400 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.007492 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-7-iscsi {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.007705 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.007799 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.008014 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.008100 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.008313 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.008405 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.008623 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.008709 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.008920 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.009007 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.009238 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.009399 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.010652 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.010790 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.010931 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.011081 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.011206 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.011338 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.011462 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.011600 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.011725 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.011859 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.011991 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.012103 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.012244 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.012372 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.012495 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.012617 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.012741 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.012863 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.012994 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.013117 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.013247 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.013366 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-7-iscsi {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.013523 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.013668 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.013785 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-7-iscsi {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.013916 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.014048 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.014172 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.014294 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.014416 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.014549 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.014676 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.014809 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.014929 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.015081 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.015238 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.015374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.015557 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.015695 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.015861 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.015988 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.016182 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.016321 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.016495 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.016628 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.016809 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.016939 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.017124 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.017252 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.017421 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.017579 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.017750 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.017879 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.018056 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.018187 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.018368 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.018496 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.018667 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.018795 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.018966 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.019104 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.019244 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.019437 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.019564 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.019696 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.019866 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.019991 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.020115 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.020238 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.020376 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.020510 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.020646 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.020770 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.020896 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.021021 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.021157 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.021281 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.021453 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.021605 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.021779 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.021911 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.022100 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.022231 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.022383 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.022509 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.022682 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.022816 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.022980 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.023107 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.023279 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.023406 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.023580 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.023787 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.023914 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.024043 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.024168 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.024299 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.024460 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.024596 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.024768 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.024908 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.025073 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.025199 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.025373 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.025530 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.025713 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.025843 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.026032 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.026159 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.026336 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.026472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.026641 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.026768 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.026966 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.027092 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.027303 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.027432 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.027608 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.027738 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.027922 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.028050 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.028223 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.028356 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.028525 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.028654 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.028822 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.028961 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.029123 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.029251 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.029500 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.029648 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.029774 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.029902 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.030038 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.030162 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.030285 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.030407 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.030581 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.030718 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.030878 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.031011 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.031183 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.031316 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.031481 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.031617 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.031782 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.031910 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.032077 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.032209 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.032379 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.032515 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.032681 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.032807 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.032982 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.033109 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.033283 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.033419 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.033622 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.033764 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.033889 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.034002 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.034184 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.034324 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.034487 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.034614 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.034788 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.034916 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.035087 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.035214 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.035388 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.035508 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.035701 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.035826 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.036003 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.036133 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.036301 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.036426 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.036599 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.036726 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.036895 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.037028 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.037195 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.037323 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.037514 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.037652 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.037821 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.037949 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.038122 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.038249 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.038421 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.038547 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.038721 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.038850 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.039017 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.039150 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.039319 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.039445 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.039656 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.039800 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.039935 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.040059 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.040204 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.040331 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.040497 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.040632 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.040798 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.040926 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.041096 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.041221 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.041395 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.041539 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.041720 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.041859 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.042017 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.042153 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.042313 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.042440 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.042609 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.042735 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.043490 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.043748 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.043873 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.044075 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.044212 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.044383 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.044511 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.044686 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.044815 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.045005 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.045132 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.045322 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.045446 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.045651 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.045780 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.045968 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.046095 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.046299 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.046436 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.046614 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:51:10.046740 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.046947 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.047082 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.047260 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.047394 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.047591 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.047719 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.047903 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.048029 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.048219 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.048354 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.048528 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.048664 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.048836 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.048971 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.049149 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.049283 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.049455 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.049603 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.049790 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.049924 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.050096 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.050199 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.050402 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.050498 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.050712 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.050829 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.051025 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.051121 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.051335 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.051430 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.051648 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.051745 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.051961 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.052058 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.052265 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.052352 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.052579 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.052674 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.052899 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.052999 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.053215 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.053310 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.053544 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.053636 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.053885 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.053974 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.054217 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.054305 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.054523 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.054619 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.054841 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.054929 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.055155 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.055244 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.055467 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.055562 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.055776 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.055924 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.056065 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.056202 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.056386 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.056527 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.056692 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.056830 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.056999 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.057135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.057311 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.057460 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.057642 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.057741 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.057959 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.058045 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.058264 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.058359 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.059149 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.059261 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.059462 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.059549 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.059769 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.059912 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.060105 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.060232 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.060356 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.060480 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.060663 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.060793 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.060992 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.061120 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.061300 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.061434 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.061625 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.061752 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.061935 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.062063 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.062243 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.062368 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.062549 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.062684 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.062857 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.062984 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.063156 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.063291 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.063458 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.063586 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.063758 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.063885 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.064063 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.064200 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.064364 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.064490 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.064672 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.064807 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.064975 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.065114 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.065282 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.065408 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.065636 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.065846 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.065973 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.066106 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.066233 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.066366 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.066521 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.066657 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.066829 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.066958 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.067132 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.067259 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.067436 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.067562 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.067739 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.067872 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.068041 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.068176 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.068346 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.068473 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.068649 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.068776 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.068950 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.069078 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.069259 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.069385 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.069581 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.069716 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.069887 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.070008 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.070210 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.070354 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.070480 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.070604 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.070784 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.070910 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.071092 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.071228 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.071400 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.071533 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.071706 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.071833 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.072013 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.072148 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.072319 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.072448 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.072626 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.072753 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.072932 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.073070 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.073245 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.073371 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.073589 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.073720 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.073922 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.074093 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.074255 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.074545 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.074673 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.074852 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.074995 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.075153 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.075281 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.075461 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.075590 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.075764 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.075921 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.076066 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.076192 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.076362 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.076488 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.076662 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.076801 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.076960 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.077088 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.077258 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.077391 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.077590 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.077728 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.077912 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.078038 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.078218 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.078346 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.078514 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.078642 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.078831 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.078940 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.079118 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.079233 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.079419 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.079515 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.079722 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.079817 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.080026 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.080182 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.080416 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.080564 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.080711 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.080852 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.080991 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.085592 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.085592 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.085720 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.085784 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.085848 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.085912 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.086016 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.086105 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.086172 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.086236 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.086300 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.086363 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.086447 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.086521 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.086587 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.086651 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.086722 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.086803 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.086890 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.086965 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.087032 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.087096 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.087161 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.087224 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.087297 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.087418 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.087501 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.087576 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.087643 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.087719 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.087787 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.087852 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.087923 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.087989 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.088054 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.088126 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.088193 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.088257 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.088321 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.088385 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.088449 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.088522 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.088597 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.088664 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.088728 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.088792 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.088855 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.088927 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.088999 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.089065 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.089129 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.089194 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.089265 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.089331 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.089402 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.089475 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.089576 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.089642 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.089744 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.089942 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.090030 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.090247 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.090347 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.090559 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.090646 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.090860 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.090955 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.091171 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.091269 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.091495 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.091589 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.091798 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.091885 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.092111 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.092195 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.092421 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.092516 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.092739 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.092832 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.093043 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.093129 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.093348 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.093435 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.093681 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.093771 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.093983 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.094069 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.094286 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.094374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.094590 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.094675 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.094893 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.094990 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.095193 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.095297 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.095498 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.095585 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.095797 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.095890 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.096101 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.096187 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.096403 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.096487 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.096700 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.096798 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.096998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.097090 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.097304 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.097391 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.097638 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.097739 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.097942 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.098029 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.098250 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.098335 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.098563 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.098659 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.098865 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.098952 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.099166 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.099260 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.099483 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.099580 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.099780 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.099865 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.100084 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.100184 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.100368 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.100481 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.100670 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.100769 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.100965 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.101049 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.101267 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.101367 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.101591 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.101683 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.101905 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.101991 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.102221 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.102311 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.102517 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.102602 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.102826 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.102911 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.103131 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.103225 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.103433 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.103517 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.103741 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.103835 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.104046 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.104130 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.104348 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.104442 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.104651 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.104755 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.104955 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.105042 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.105255 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.105845 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.106093 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.106286 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.106411 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.106596 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.106715 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.106904 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.107019 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.107212 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.107320 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.107532 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.107618 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.107839 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.107938 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.108401 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.108494 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.108705 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.109004 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.109096 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.109310 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.109401 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.109650 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.109755 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.109967 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.110214 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.110319 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.110544 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.110653 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.110853 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.110936 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.111169 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.111256 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.111509 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.111606 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.111813 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.111910 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.112119 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.112207 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.112421 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.112516 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.112723 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.112809 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.113029 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.113115 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.113330 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.113427 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.113657 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.113735 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.113959 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.114033 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.114265 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.114353 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.114565 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.114640 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.114861 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.114935 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.115160 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.115237 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.115463 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.115538 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.115761 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.115836 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.116061 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.116137 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.116361 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.116443 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.116659 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.116733 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.116969 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.117044 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.117269 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.117360 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.117590 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.117692 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.117890 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.117978 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.118188 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.118273 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.118502 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.118587 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.118804 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.118880 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.119104 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.119179 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.119402 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.119488 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.119738 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.119853 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.120037 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.120114 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.120327 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.120410 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.120641 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.120729 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.120957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.121056 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.121287 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.121365 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.121611 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.121690 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.121920 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.121996 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.122223 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.122308 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.122521 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.122610 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.123305 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.123388 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.123619 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.123707 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.123923 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.124009 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.124218 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.124312 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.124513 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.124599 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.124816 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.124903 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.125116 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.125208 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.125418 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.125540 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.125745 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.125833 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.126050 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.126148 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.126348 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.126433 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.126651 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.126735 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.126955 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.127118 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.127252 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.127338 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.127547 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.127631 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.127841 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.127935 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.128142 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.128227 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.128439 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.128524 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.128737 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.128837 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.129034 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.129119 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.129334 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.129418 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.129656 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.129746 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.129954 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.130038 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.130270 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.130354 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.130564 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.130693 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.130864 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.130962 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.131158 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.131244 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.131458 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.131544 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.131756 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.131842 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.132052 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.132145 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.132349 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.132435 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.132652 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.132738 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.132960 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.133053 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.133258 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.133341 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.133587 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.133679 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.133891 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.133990 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.134191 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.134278 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.134490 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.134577 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.134793 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.134888 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.135091 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.135179 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.135389 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.135476 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.135684 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.135778 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.135985 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.136070 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.136280 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.136364 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.136617 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.136712 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.136920 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.137007 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.137217 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.137302 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.137537 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.137641 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.137840 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.137940 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.138150 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.138236 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.138449 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.138538 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.138748 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.138834 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.139045 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.139131 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.139379 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.139467 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.139677 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.139762 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.139985 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.140078 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.140292 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.140378 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.140607 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.140719 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.140911 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.141018 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.141214 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.141316 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.141536 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.141627 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.141846 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.141953 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.142144 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.142230 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.142443 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.142530 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.142745 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.142839 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.143049 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.143140 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.143345 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.143439 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.143643 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.143732 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.143956 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.144041 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.144261 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.144347 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.144559 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.144644 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.144863 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.144948 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.145167 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.145253 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.145468 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.145606 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.145793 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.145878 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.146096 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.146192 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.146399 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.146486 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.146703 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.146789 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.147008 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.147092 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.147310 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.147403 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.147613 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.147697 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.147952 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.148062 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.148221 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.148306 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.148522 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.148607 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.148823 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.148916 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.149121 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.149213 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.149427 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.149543 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.149754 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.149856 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.150052 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.150137 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.150351 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.150435 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.150665 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.150758 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.150955 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.151054 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.151261 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.151373 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.151560 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.151680 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.151865 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.151987 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.152166 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.152339 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.152621 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.152709 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.152928 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.153014 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.153236 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.153321 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.153559 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.153651 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.153862 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.153958 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.154165 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.154275 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.154477 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.154586 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.154793 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.154878 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.155096 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.155255 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.155471 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.155566 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.155770 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.155855 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.156078 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.156174 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.156384 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.156470 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.156684 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.156769 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.156982 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.157077 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.157278 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.157363 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.157619 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.157708 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.157924 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.158046 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.158225 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.158326 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.158524 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.158634 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.158842 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.158930 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.159141 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.159226 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.159458 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.159624 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.159865 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.159959 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.160172 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.160258 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.160475 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.160560 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.160839 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.160945 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.161160 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.161247 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.161461 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.161595 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.161799 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.161885 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.162109 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.162205 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.162427 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.162513 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.162729 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.162815 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.163040 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.163135 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.163344 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.163431 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.163644 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.163737 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.163966 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.164053 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.164269 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.164361 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.164580 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.164680 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.164886 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.164980 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.165204 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.165298 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.165539 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.165728 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.165852 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.165941 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.166170 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.166256 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.166543 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.166630 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.166848 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.166936 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.167153 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.167239 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.167463 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.167551 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.167766 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.168369 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.168575 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.168662 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.168913 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.169004 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.169224 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.169310 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.169546 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.169635 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.169854 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.169951 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.170159 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.170254 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.170461 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.170565 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.170763 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.170846 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.171067 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.171153 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.171369 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.171464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.171668 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.171754 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.171970 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.172057 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.172290 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.172386 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.172591 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.172678 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.172892 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.172980 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.173209 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.173304 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.173535 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.173671 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.173840 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.173991 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.174140 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.174293 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.174440 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.174612 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.174775 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.174920 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.175079 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.175226 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.175396 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.175527 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.175721 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.175828 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.176047 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.176165 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.176361 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.176456 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.176689 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.176778 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.177013 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.177100 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.177330 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.177424 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.177662 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.177762 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.177977 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.178064 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.178298 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.178439 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.178600 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.178696 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.178902 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.179005 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.179205 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.179299 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.179507 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.179603 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.179808 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.179895 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.180108 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.180196 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.180413 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.180509 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.180713 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.180798 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.181008 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.181096 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.181307 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.181391 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.181635 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.181724 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.181941 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.182041 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.182245 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.182334 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.182548 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.182635 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.182845 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.182930 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.183145 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.183234 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.183463 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.183550 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.184292 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.184378 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.184598 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.184686 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.184903 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.184989 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.185210 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.185305 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.185555 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.185643 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.185864 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.185951 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.186176 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.186270 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.186481 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.186566 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.186794 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.186879 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.187105 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.187199 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.187414 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.187499 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.187724 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.187810 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.188028 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.188126 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.188335 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.188421 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.188644 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.188736 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.188953 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.189051 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.189257 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.189469 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.189592 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.189819 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.189922 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.190133 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.190220 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.190445 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.190713 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.190800 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.191037 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.191120 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.191347 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.191431 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.191656 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.191740 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.191962 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.192056 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.192270 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.192356 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.192576 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.192670 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.192887 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.192974 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.193196 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.193283 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.193523 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.193626 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.193835 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.193922 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.194158 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.194241 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.194467 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.194566 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.194781 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.194868 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.195092 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.195179 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.195416 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.195503 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.195729 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.195821 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.196028 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.196120 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.196337 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.196424 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.196644 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.196729 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.196954 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.197049 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.197260 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.197346 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.197591 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.197691 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.197901 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.197995 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.198208 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.198293 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.198512 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.198593 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.198817 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.198904 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.199148 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.199234 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.199457 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.199543 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.199765 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.199853 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.200072 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.200159 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.200381 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.200468 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.200686 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.200773 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.200997 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.201083 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.201310 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.201392 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.201648 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.201855 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.201943 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.202170 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.202258 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.202499 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.202588 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.202821 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.203053 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.203139 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.203371 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.203468 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.203705 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.203792 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.204033 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.204120 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.204336 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.204429 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.204636 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.204724 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.204941 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.205027 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.205244 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.205342 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.205601 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.205689 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.205911 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.206006 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.206221 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.206309 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.206529 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.206616 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.206830 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.206916 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.207132 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.207225 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.207441 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.207661 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.207749 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.208009 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.208105 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.208325 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.208411 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.208649 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.208848 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.208972 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.209191 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.209277 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.209521 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.209611 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.209850 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.209949 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.210171 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.210264 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.210485 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.210572 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.210788 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.210884 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.211093 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.211178 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.211395 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.211478 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.211697 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.211788 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.212004 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.212091 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.212310 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.212397 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.212611 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.212697 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.212914 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.213001 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.213212 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.213297 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.213534 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.213623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.213841 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.213928 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.214141 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.214226 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.214440 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.214531 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.214780 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.214866 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.215086 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.215171 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.215388 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.215475 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.215691 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.215777 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.215991 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.216085 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.216291 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.216377 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.216595 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.216690 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.216898 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.216992 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.217197 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.217284 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.217542 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.217633 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.217825 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.217923 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.218132 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.218220 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.218434 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.218521 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.218742 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.218837 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.219046 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.219137 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.219346 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.219438 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.219657 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.219745 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.219960 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.220048 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.220272 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.220358 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.220575 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.220663 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.220877 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.220963 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.221182 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.221268 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.221516 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.221602 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.221828 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.222062 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.222148 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.222392 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.222499 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.222706 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.222794 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.223035 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.223283 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.223378 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.223617 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.223703 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.223936 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.224022 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.224235 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.224396 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.224553 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.224641 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.224859 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.224949 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.225168 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.225263 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.225469 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.225633 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.225797 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.225883 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.226103 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.226203 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.226411 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.226497 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.226713 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.226798 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.227019 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.227107 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.227324 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.227410 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.227627 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.227713 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.227932 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.228018 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.228233 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.228318 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.228587 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.228688 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.228836 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.228923 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.229141 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.229227 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.229447 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.229581 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.229780 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.229868 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.230087 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.230181 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.230907 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.231010 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.231219 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.231306 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.231528 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.231615 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.231838 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.231942 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.232146 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.232237 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.232454 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.232541 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.232759 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.232847 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.233315 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.233408 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.233657 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.233746 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.233961 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.234051 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.234361 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.234629 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.234717 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.234940 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.235040 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.235257 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.235345 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.235575 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.235880 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.235976 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.236200 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.236289 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.236521 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.236608 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.236833 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.236931 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.237150 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.237237 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.237456 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.237615 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.237801 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.237907 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.238135 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.238233 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.238460 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.238554 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.238770 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.238857 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.239070 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.239156 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.239373 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.239458 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.239675 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.239763 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.239979 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.240067 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.240292 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.240380 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.240599 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.240687 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.240900 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.240987 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.241206 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.241330 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.241530 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.241627 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.241835 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.241934 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.242134 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.242234 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.242466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.242553 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.242773 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.242860 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.243077 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.243176 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.243375 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.243470 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.243673 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.243759 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.243970 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.244064 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.244267 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.244354 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.244564 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.244650 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.244860 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.244958 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.245156 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.245243 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.245451 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.245591 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.245775 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.245871 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.246618 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.246713 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.246926 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.247011 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.247221 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.247307 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.247519 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.247607 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.247819 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.247922 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.248120 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.248208 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.248419 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.248505 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.248744 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.248838 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.249058 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.249145 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.249362 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.249447 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.249704 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.249804 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.250012 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.250099 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.250319 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.250404 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.250623 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.250723 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.250942 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.251028 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.251244 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.251330 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.251549 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.251644 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.251871 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.252005 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.252157 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.252286 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.252462 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.252560 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.252768 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.252861 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.253072 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.253159 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.253379 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.253467 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.253706 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.253803 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.254012 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.254097 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.254329 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.254418 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.254647 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.254735 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.254961 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.255087 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.255269 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.255423 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.255596 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.255740 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.255903 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.256058 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.256211 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.256370 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.256518 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.256678 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.256831 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.257004 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.257137 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.257310 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.257449 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.257643 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.257777 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.257954 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.258083 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.258262 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.258396 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.258569 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.258710 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.258882 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.259034 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.259190 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.259357 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.259499 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.259665 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.259814 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.259985 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.260129 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.260308 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.260455 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.260648 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.260777 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.260958 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.261085 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.261297 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.261394 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.261671 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.261798 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.261979 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.262143 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.262285 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.262455 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.262588 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.262798 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.262895 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103668) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 12:51:10.263124 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.263435 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.263744 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.264046 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:51:10.264288 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 12:51:10.415480 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO dbcounter [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] Registered counter for database nova_api Oct 14 12:51:10.416920 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO dbcounter [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Registered counter for database nova_api Oct 14 12:51:10.436874 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG oslo_db.sqlalchemy.engines [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:51:10.438634 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_db.sqlalchemy.engines [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103667) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:51:10.443543 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG dbcounter [-] [103668] Writer thread running {{(pid=103668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:51:10.445092 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG dbcounter [-] [103667] Writer thread running {{(pid=103667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:51:10.500269 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.context [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),855abc56-36ec-427f-934f-3735e458a612(cell1) {{(pid=103668) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 12:51:10.501098 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.context [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),855abc56-36ec-427f-934f-3735e458a612(cell1) {{(pid=103667) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 12:51:10.504108 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG oslo_concurrency.lockutils [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:51:10.504582 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG oslo_concurrency.lockutils [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:51:10.504919 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:51:10.505385 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:51:10.506162 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG oslo_concurrency.lockutils [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:51:10.506885 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG oslo_concurrency.lockutils [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:51:10.506977 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:51:10.507325 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG oslo_concurrency.lockutils [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:51:10.507654 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:51:10.508094 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:51:10.509279 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG oslo_concurrency.lockutils [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103668) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:51:10.510104 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:51:10.511275 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO dbcounter [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] Registered counter for database nova_cell0 Oct 14 12:51:10.512119 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO dbcounter [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Registered counter for database nova_cell0 Oct 14 12:51:10.515326 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO dbcounter [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] Registered counter for database nova_cell1 Oct 14 12:51:10.516030 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO dbcounter [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Registered counter for database nova_cell1 Oct 14 12:51:10.522194 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG oslo_db.sqlalchemy.engines [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:51:10.523880 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_db.sqlalchemy.engines [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103667) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:51:10.526692 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG oslo_db.sqlalchemy.engines [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:51:10.529163 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG dbcounter [-] [103667] Writer thread running {{(pid=103667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:51:10.529823 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_db.sqlalchemy.engines [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103667) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:51:10.530151 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG dbcounter [-] [103668] Writer thread running {{(pid=103668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:51:10.669936 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG dbcounter [-] [103667] Writer thread running {{(pid=103667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:51:10.671602 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG dbcounter [-] [103668] Writer thread running {{(pid=103668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:51:10.678401 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO dbcounter [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Registered counter for database nova_cell0 Oct 14 12:51:10.680123 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO dbcounter [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] Registered counter for database nova_cell0 Oct 14 12:51:10.687234 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_db.sqlalchemy.engines [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103667) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:51:10.690829 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG oslo_db.sqlalchemy.engines [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103668) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:51:10.691857 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG dbcounter [-] [103667] Writer thread running {{(pid=103667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:51:10.695543 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG dbcounter [-] [103668] Writer thread running {{(pid=103668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:51:11.024789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: WARNING keystonemiddleware.auth_token [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 12:51:11.028396 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: WARNING keystonemiddleware.auth_token [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 12:51:11.032567 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: WARNING keystonemiddleware.auth_token [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 12:51:11.035635 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: WARNING keystonemiddleware.auth_token [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 12:51:11.372795 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: WARNING keystonemiddleware.auth_token [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 12:51:11.378485 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: WARNING keystonemiddleware.auth_token [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 12:51:11.378775 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: WARNING keystonemiddleware.auth_token [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 12:51:11.384030 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b34d5839c0 pid: 103667 (default app) Oct 14 12:51:11.384388 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: WARNING keystonemiddleware.auth_token [None req-f9c9c986-e363-4076-9877-dd4b8883586a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 12:51:11.386096 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:51:11.387320 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001784 Oct 14 12:51:11.387723 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Fri Oct 14 12:51:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:51:11.389705 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b34d5839c0 pid: 103668 (default app) Oct 14 12:52:31.909724 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:52:31.910672 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 14 12:52:31.911062 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 931 bytes} [Fri Oct 14 12:52:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:52:31.923057 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG dbcounter [-] [103668] Writing DB stats nova_api:SELECT=3 {{(pid=103668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:31.924162 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG dbcounter [-] [103668] Writing DB stats nova_cell1:SELECT=3 {{(pid=103668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:31.925171 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG dbcounter [-] [103668] Writing DB stats nova_cell0:SELECT=3 {{(pid=103668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:31.927603 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG dbcounter [-] [103668] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:32.824999 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-9cbaaf9d-2baa-46b8-ae0f-466826a92e3c admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:52:32.858453 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-9cbaaf9d-2baa-46b8-ae0f-466826a92e3c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.940202 Oct 14 12:52:32.859201 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1292 bytes} [Fri Oct 14 12:52:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 12:52:35.496688 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:52:35.497748 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-6cd61a1a-3a29-49fd-bf95-6955df054b4b None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 14 12:52:35.498149 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 931 bytes} [Fri Oct 14 12:52:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:52:35.953679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-333a8481-a6dc-4499-ae0d-362ea4eef906 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "swap": 0, "name": "cirros256", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:52:36.000744 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-333a8481-a6dc-4499-ae0d-362ea4eef906 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.496533 Oct 14 12:52:36.001308 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1283 bytes} [Fri Oct 14 12:52:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 14 12:52:36.015204 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG dbcounter [-] [103667] Writing DB stats nova_api:SELECT=3 {{(pid=103667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:36.016002 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG dbcounter [-] [103667] Writing DB stats nova_cell0:SELECT=3 {{(pid=103667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:36.017925 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG dbcounter [-] [103667] Writing DB stats nova_cell1:SELECT=3 {{(pid=103667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:36.018815 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG dbcounter [-] [103667] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:52:36.223601 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-9da6e6e4-71fa-4d86-83e3-c7b5ffeac5fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:52:36.289697 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-9da6e6e4-71fa-4d86-83e3-c7b5ffeac5fd admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.279869 Oct 14 12:52:36.290282 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1336 bytes} [Fri Oct 14 12:52:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 12:52:38.914011 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-333a8481-a6dc-4499-ae0d-362ea4eef906 admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:52:38.915292 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-333a8481-a6dc-4499-ae0d-362ea4eef906 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001734 Oct 14 12:52:38.916002 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 931 bytes} [Fri Oct 14 12:52:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:52:39.569778 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-d98f2a44-0e65-4fac-9884-e31d6a17029c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0}} {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:52:39.609720 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-d98f2a44-0e65-4fac-9884-e31d6a17029c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.687487 Oct 14 12:52:39.610293 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1283 bytes} [Fri Oct 14 12:52:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 12:52:39.623008 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-c6a8af30-8596-4fe3-801c-caf01d7a32e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:52:39.676238 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-c6a8af30-8596-4fe3-801c-caf01d7a32e9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056819 Oct 14 12:52:39.677036 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1336 bytes} [Fri Oct 14 12:52:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 12:52:42.347896 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-d98f2a44-0e65-4fac-9884-e31d6a17029c admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:52:42.348915 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-d98f2a44-0e65-4fac-9884-e31d6a17029c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 14 12:52:42.349316 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 931 bytes} [Fri Oct 14 12:52:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:52:42.769191 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-08c9ed39-a965-4276-afd0-f67a8e3ad6dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "swap": 0, "id": "d2", "os-flavor-access:is_public": true, "disk": 10}} {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:52:42.788645 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-08c9ed39-a965-4276-afd0-f67a8e3ad6dc admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.432554 Oct 14 12:52:42.789202 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1283 bytes} [Fri Oct 14 12:52:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 12:52:42.801991 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-c85fdc17-9e8a-46c0-aab7-00c5dd472464 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:52:42.829979 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-c85fdc17-9e8a-46c0-aab7-00c5dd472464 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031547 Oct 14 12:52:42.832461 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1336 bytes} [Fri Oct 14 12:52:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 12:52:45.491431 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-08c9ed39-a965-4276-afd0-f67a8e3ad6dc admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:52:45.492547 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-08c9ed39-a965-4276-afd0-f67a8e3ad6dc admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 14 12:52:45.493461 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 931 bytes} [Fri Oct 14 12:52:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:52:45.913473 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-aa6226ca-4594-45e7-a13e-e081c2a73d47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "name": "ds2G", "id": "d3"}} {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:52:45.933347 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-aa6226ca-4594-45e7-a13e-e081c2a73d47 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433759 Oct 14 12:52:45.937538 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1283 bytes} [Fri Oct 14 12:52:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 12:52:45.946792 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-7d9b2b58-1037-47e1-859a-086e1b32560b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:52:45.975905 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-7d9b2b58-1037-47e1-859a-086e1b32560b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033396 Oct 14 12:52:45.991373 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1336 bytes} [Fri Oct 14 12:52:45 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 12:52:48.717596 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-aa6226ca-4594-45e7-a13e-e081c2a73d47 admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:52:48.718906 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-aa6226ca-4594-45e7-a13e-e081c2a73d47 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001920 Oct 14 12:52:48.719595 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 931 bytes} [Fri Oct 14 12:52:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:52:49.188106 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-f0b52f2a-7fcf-415f-b736-c88dae5078ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "ram": 4096, "disk": 20, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:52:49.207764 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-f0b52f2a-7fcf-415f-b736-c88dae5078ff admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.480903 Oct 14 12:52:49.208493 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1283 bytes} [Fri Oct 14 12:52:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 12:52:49.222589 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-652a6588-894c-4f51-90fb-13e76534f7c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:52:49.251389 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-652a6588-894c-4f51-90fb-13e76534f7c8 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033365 Oct 14 12:52:49.252078 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1336 bytes} [Fri Oct 14 12:52:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 12:52:51.983621 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-f0b52f2a-7fcf-415f-b736-c88dae5078ff admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:52:51.984651 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-f0b52f2a-7fcf-415f-b736-c88dae5078ff admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001719 Oct 14 12:52:51.985080 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 931 bytes} [Fri Oct 14 12:52:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:52:52.402355 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-f56889e0-4ed5-483c-b0e1-8916761575c1 admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:52:52.427566 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-f56889e0-4ed5-483c-b0e1-8916761575c1 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.435029 Oct 14 12:52:52.428132 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1292 bytes} [Fri Oct 14 12:52:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 12:52:55.355039 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-f0b52f2a-7fcf-415f-b736-c88dae5078ff admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:52:55.356086 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-f0b52f2a-7fcf-415f-b736-c88dae5078ff admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 14 12:52:55.356476 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 931 bytes} [Fri Oct 14 12:52:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 12:52:55.746748 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-f70f7f20-c2e7-4155-be7c-99e14aac63ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "swap": 0}} {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:52:55.767498 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-f70f7f20-c2e7-4155-be7c-99e14aac63ad admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.404651 Oct 14 12:52:55.768141 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1283 bytes} [Fri Oct 14 12:52:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 12:52:55.780817 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-bb764e17-314d-4a0d-839e-026da91c4310 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:52:55.809508 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-bb764e17-314d-4a0d-839e-026da91c4310 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032518 Oct 14 12:52:55.810097 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1333 bytes} [Fri Oct 14 12:52:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 12:52:58.429026 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-f70f7f20-c2e7-4155-be7c-99e14aac63ad admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:52:58.430213 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-f70f7f20-c2e7-4155-be7c-99e14aac63ad admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001588 Oct 14 12:52:58.430828 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 931 bytes} [Fri Oct 14 12:52:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:52:58.803047 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-3c8c6527-632f-4587-a7ad-bdefb2eaceb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048}} {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:52:58.824521 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-3c8c6527-632f-4587-a7ad-bdefb2eaceb3 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.387209 Oct 14 12:52:58.825081 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1283 bytes} [Fri Oct 14 12:52:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 12:52:58.838454 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-f7289140-c99e-4531-823c-adaab63664ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:52:58.865882 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-f7289140-c99e-4531-823c-adaab63664ab admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032203 Oct 14 12:52:58.866805 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1333 bytes} [Fri Oct 14 12:52:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 12:53:01.487181 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-3c8c6527-632f-4587-a7ad-bdefb2eaceb3 admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:01.488204 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-3c8c6527-632f-4587-a7ad-bdefb2eaceb3 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 14 12:53:01.488606 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 931 bytes} [Fri Oct 14 12:53:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:53:01.932680 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-1dfc17e9-6acf-4122-b5c2-c5c4d8ed1723 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "id": "3"}} {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:53:01.955336 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-1dfc17e9-6acf-4122-b5c2-c5c4d8ed1723 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.460231 Oct 14 12:53:01.956181 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1283 bytes} [Fri Oct 14 12:53:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 12:53:01.968761 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-e20254b2-fd9f-4adb-bd55-a27d7456a675 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:53:01.974324 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG dbcounter [-] [103668] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:02.006070 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-e20254b2-fd9f-4adb-bd55-a27d7456a675 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040931 Oct 14 12:53:02.006884 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1333 bytes} [Fri Oct 14 12:53:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 12:53:04.645834 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-1dfc17e9-6acf-4122-b5c2-c5c4d8ed1723 admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:04.646846 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-1dfc17e9-6acf-4122-b5c2-c5c4d8ed1723 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 14 12:53:04.647416 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 931 bytes} [Fri Oct 14 12:53:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:53:05.108436 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-ccb3a51d-3a7b-46fb-82c7-650a8cd19d80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "vcpus": 4}} {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:53:05.133871 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-ccb3a51d-3a7b-46fb-82c7-650a8cd19d80 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.479362 Oct 14 12:53:05.134530 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1283 bytes} [Fri Oct 14 12:53:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 12:53:05.146751 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-89a69fa5-861b-4218-99e7-6e3bb6f24691 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:53:05.174443 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-89a69fa5-861b-4218-99e7-6e3bb6f24691 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031299 Oct 14 12:53:05.175028 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1333 bytes} [Fri Oct 14 12:53:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 12:53:07.824039 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-ccb3a51d-3a7b-46fb-82c7-650a8cd19d80 admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:07.825201 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-ccb3a51d-3a7b-46fb-82c7-650a8cd19d80 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Oct 14 12:53:07.825643 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 931 bytes} [Fri Oct 14 12:53:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:53:08.268723 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-b26ecd28-8f4d-49f6-b625-b7595b258854 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384}} {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:53:08.278212 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG dbcounter [-] [103667] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:08.290062 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-b26ecd28-8f4d-49f6-b625-b7595b258854 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.458045 Oct 14 12:53:08.294526 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1283 bytes} [Fri Oct 14 12:53:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 12:53:08.302596 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-00744a96-bccb-418b-be39-8aef703fbcc2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:53:08.328690 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-00744a96-bccb-418b-be39-8aef703fbcc2 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029692 Oct 14 12:53:08.329273 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1333 bytes} [Fri Oct 14 12:53:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 12:53:24.563140 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-b26ecd28-8f4d-49f6-b625-b7595b258854 admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:24.564071 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-b26ecd28-8f4d-49f6-b625-b7595b258854 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 14 12:53:24.564468 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 931 bytes} [Fri Oct 14 12:53:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:53:24.575259 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG dbcounter [-] [103668] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:53:24.950204 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-558abd26-7406-4bfd-a1d6-2b4111f32b3c admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:24.968038 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-558abd26-7406-4bfd-a1d6-2b4111f32b3c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397217 Oct 14 12:53:24.968568 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1292 bytes} [Fri Oct 14 12:53:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 12:53:26.260065 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-b26ecd28-8f4d-49f6-b625-b7595b258854 admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:26.261057 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-b26ecd28-8f4d-49f6-b625-b7595b258854 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 14 12:53:26.261451 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Oct 14 12:53:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:53:26.771461 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-9e118975-e622-4b26-9dff-24d3c0f563a2 admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:26.777267 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.wsgi [None req-9e118975-e622-4b26-9dff-24d3c0f563a2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-9e118975-e622-4b26-9dff-24d3c0f563a2 admin admin] Request method failure captured: Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Accept: application/json Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Accept-Encoding: gzip, deflate Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Connection: keep-alive Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Content-Length: 0 Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Host: 10.222.0.47 Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Openstack-Api-Version: compute 2.92 Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Openstack-System-Scope: None Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: User-Agent: python-novaclient Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Auth-Token: gAAAAABjSVvGjd9lJGaigfWpkQiWDOpUj7HdjA4QvlVDxuQba1P4889qeKEgXH-mJF0P0Q1huvfCXEAgbhuVGP9kDOYW2nDyKoculpG1ega6-jogG2sG0slVUk5aIlRqTUBLHD4o97_ZQUf5dsErd6rFRHNdQH7rBySOispqEe45SyT3uI0Z1Jk Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Domain-Id: None Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Domain-Name: None Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Identity-Status: Confirmed Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Is-Admin-Project: True Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Project-Domain-Id: default Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Project-Domain-Name: Default Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Project-Id: 48f83413dd8d497d98e9b13f0fa4b793 Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Project-Name: admin Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Role: member,reader,admin Oct 14 12:53:26.780466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Roles: member,reader,admin Oct 14 12:53:26.782094 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_48f83413dd8d497d98e9b13f0fa4b793", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 12:53:26.782094 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Tenant: admin Oct 14 12:53:26.782094 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Tenant-Id: 48f83413dd8d497d98e9b13f0fa4b793 Oct 14 12:53:26.782094 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Tenant-Name: admin Oct 14 12:53:26.782094 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-User: admin Oct 14 12:53:26.782094 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-User-Domain-Id: default Oct 14 12:53:26.782094 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-User-Domain-Name: Default Oct 14 12:53:26.782094 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-User-Id: ced917b9e08744f88e2078e19eb8640b Oct 14 12:53:26.782094 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-User-Name: admin Oct 14 12:53:26.782094 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: method: > Oct 14 12:53:26.782094 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: exception: Flavor 42 could not be found. Oct 14 12:53:26.782094 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: action_args: {'id': '42'} Oct 14 12:53:26.782094 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 12:53:26.782094 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:53:26.783472 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Oct 14 12:53:26.784623 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-9e118975-e622-4b26-9dff-24d3c0f563a2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 12:53:26.786222 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-9e118975-e622-4b26-9dff-24d3c0f563a2 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.385655 Oct 14 12:53:26.786222 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Oct 14 12:53:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:26.791559 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-2a066803-d521-474b-a5d0-00534ea7dc5f admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:26.815064 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-2a066803-d521-474b-a5d0-00534ea7dc5f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027021 Oct 14 12:53:26.815534 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Oct 14 12:53:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 12:53:26.826433 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-d6593ff7-cef6-4556-b4bd-765f573ddb65 admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:26.848034 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-d6593ff7-cef6-4556-b4bd-765f573ddb65 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026055 Oct 14 12:53:26.848565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Oct 14 12:53:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 12:53:26.857510 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-93786703-958a-4a64-b6ec-5b19ebe2e26c admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:26.863052 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.wsgi [None req-93786703-958a-4a64-b6ec-5b19ebe2e26c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-93786703-958a-4a64-b6ec-5b19ebe2e26c admin admin] Request method failure captured: Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Accept: application/json Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Accept-Encoding: gzip, deflate Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Connection: keep-alive Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Content-Length: 0 Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Host: 10.222.0.47 Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Openstack-Api-Version: compute 2.92 Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Openstack-System-Scope: None Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: User-Agent: python-novaclient Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Auth-Token: gAAAAABjSVvGjd9lJGaigfWpkQiWDOpUj7HdjA4QvlVDxuQba1P4889qeKEgXH-mJF0P0Q1huvfCXEAgbhuVGP9kDOYW2nDyKoculpG1ega6-jogG2sG0slVUk5aIlRqTUBLHD4o97_ZQUf5dsErd6rFRHNdQH7rBySOispqEe45SyT3uI0Z1Jk Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Domain-Id: None Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Domain-Name: None Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Identity-Status: Confirmed Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Is-Admin-Project: True Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Project-Domain-Id: default Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Project-Domain-Name: Default Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Project-Id: 48f83413dd8d497d98e9b13f0fa4b793 Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Project-Name: admin Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Role: member,reader,admin Oct 14 12:53:26.866789 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Roles: member,reader,admin Oct 14 12:53:26.868358 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_48f83413dd8d497d98e9b13f0fa4b793", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 12:53:26.868358 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Tenant: admin Oct 14 12:53:26.868358 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Tenant-Id: 48f83413dd8d497d98e9b13f0fa4b793 Oct 14 12:53:26.868358 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Tenant-Name: admin Oct 14 12:53:26.868358 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-User: admin Oct 14 12:53:26.868358 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-User-Domain-Id: default Oct 14 12:53:26.868358 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-User-Domain-Name: Default Oct 14 12:53:26.868358 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-User-Id: ced917b9e08744f88e2078e19eb8640b Oct 14 12:53:26.868358 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-User-Name: admin Oct 14 12:53:26.868358 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: method: > Oct 14 12:53:26.868358 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: exception: Flavor 42 could not be found. Oct 14 12:53:26.868358 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: action_args: {'id': '42'} Oct 14 12:53:26.868358 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 12:53:26.868358 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:53:26.869223 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Oct 14 12:53:26.870464 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-93786703-958a-4a64-b6ec-5b19ebe2e26c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 12:53:26.871821 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-93786703-958a-4a64-b6ec-5b19ebe2e26c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014086 Oct 14 12:53:26.871821 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Oct 14 12:53:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:28.077394 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-d6593ff7-cef6-4556-b4bd-765f573ddb65 admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:28.078440 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-d6593ff7-cef6-4556-b4bd-765f573ddb65 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Oct 14 12:53:28.078851 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Oct 14 12:53:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:53:28.595804 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-a0b9e580-0904-49cf-8f75-87295af65436 admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:28.601308 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.wsgi [None req-a0b9e580-0904-49cf-8f75-87295af65436 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-a0b9e580-0904-49cf-8f75-87295af65436 admin admin] Request method failure captured: Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Accept: application/json Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Accept-Encoding: gzip, deflate Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Connection: keep-alive Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Content-Length: 0 Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Host: 10.222.0.47 Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Openstack-Api-Version: compute 2.92 Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Openstack-System-Scope: None Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: User-Agent: python-novaclient Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Auth-Token: gAAAAABjSVvHsktkswEOvJLrhXWra5Ig1TR24QsljtnXq_Ey_BKiis_JjWuzqXGjCt_iPolCi8wWhk1rhabwYT5NKPF99k6CJb93v8rOCqnACz85noE64LEjCI_HrqATlzN8lBqPc_orkZQ0-X4RxcbVDQgyAFPdgnjWsaHoBgGF2ZRSllyosfg Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Domain-Id: None Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Domain-Name: None Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Identity-Status: Confirmed Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Is-Admin-Project: True Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Project-Domain-Id: default Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Project-Domain-Name: Default Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Project-Id: 48f83413dd8d497d98e9b13f0fa4b793 Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Project-Name: admin Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Role: member,reader,admin Oct 14 12:53:28.602881 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Roles: member,reader,admin Oct 14 12:53:28.604511 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_48f83413dd8d497d98e9b13f0fa4b793", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 12:53:28.604511 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Tenant: admin Oct 14 12:53:28.604511 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Tenant-Id: 48f83413dd8d497d98e9b13f0fa4b793 Oct 14 12:53:28.604511 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Tenant-Name: admin Oct 14 12:53:28.604511 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-User: admin Oct 14 12:53:28.604511 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-User-Domain-Id: default Oct 14 12:53:28.604511 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-User-Domain-Name: Default Oct 14 12:53:28.604511 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-User-Id: ced917b9e08744f88e2078e19eb8640b Oct 14 12:53:28.604511 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-User-Name: admin Oct 14 12:53:28.604511 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: method: > Oct 14 12:53:28.604511 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: exception: Flavor 84 could not be found. Oct 14 12:53:28.604511 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: action_args: {'id': '84'} Oct 14 12:53:28.604511 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 12:53:28.604511 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:53:28.605374 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Oct 14 12:53:28.606827 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-a0b9e580-0904-49cf-8f75-87295af65436 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 12:53:28.608119 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-a0b9e580-0904-49cf-8f75-87295af65436 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.387812 Oct 14 12:53:28.608119 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Oct 14 12:53:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:28.614343 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-11c5f7a8-b477-431c-9da2-89c464051eb3 admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:28.629145 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-11c5f7a8-b477-431c-9da2-89c464051eb3 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018449 Oct 14 12:53:28.629723 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Oct 14 12:53:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 12:53:28.639264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-4e060243-8366-4e91-a855-e1e88c9e0f9a admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:28.655096 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-4e060243-8366-4e91-a855-e1e88c9e0f9a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019479 Oct 14 12:53:28.655596 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Oct 14 12:53:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 12:53:28.665509 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-46c97d40-bd25-4a37-b532-f1e5d6b41be7 admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:28.670476 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.wsgi [None req-46c97d40-bd25-4a37-b532-f1e5d6b41be7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-46c97d40-bd25-4a37-b532-f1e5d6b41be7 admin admin] Request method failure captured: Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Accept: application/json Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Accept-Encoding: gzip, deflate Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Connection: keep-alive Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Content-Length: 0 Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Host: 10.222.0.47 Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Openstack-Api-Version: compute 2.92 Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Openstack-System-Scope: None Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: User-Agent: python-novaclient Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Auth-Token: gAAAAABjSVvHsktkswEOvJLrhXWra5Ig1TR24QsljtnXq_Ey_BKiis_JjWuzqXGjCt_iPolCi8wWhk1rhabwYT5NKPF99k6CJb93v8rOCqnACz85noE64LEjCI_HrqATlzN8lBqPc_orkZQ0-X4RxcbVDQgyAFPdgnjWsaHoBgGF2ZRSllyosfg Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Domain-Id: None Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Domain-Name: None Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Identity-Status: Confirmed Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Is-Admin-Project: True Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Project-Domain-Id: default Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Project-Domain-Name: Default Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Project-Id: 48f83413dd8d497d98e9b13f0fa4b793 Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Project-Name: admin Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Role: member,reader,admin Oct 14 12:53:28.671957 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Roles: member,reader,admin Oct 14 12:53:28.673532 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_48f83413dd8d497d98e9b13f0fa4b793", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 12:53:28.673532 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Tenant: admin Oct 14 12:53:28.673532 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Tenant-Id: 48f83413dd8d497d98e9b13f0fa4b793 Oct 14 12:53:28.673532 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Tenant-Name: admin Oct 14 12:53:28.673532 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-User: admin Oct 14 12:53:28.673532 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-User-Domain-Id: default Oct 14 12:53:28.673532 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-User-Domain-Name: Default Oct 14 12:53:28.673532 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-User-Id: ced917b9e08744f88e2078e19eb8640b Oct 14 12:53:28.673532 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-User-Name: admin Oct 14 12:53:28.673532 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: method: > Oct 14 12:53:28.673532 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: exception: Flavor 84 could not be found. Oct 14 12:53:28.673532 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: action_args: {'id': '84'} Oct 14 12:53:28.673532 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 12:53:28.673532 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:53:28.674565 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Oct 14 12:53:28.675679 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-46c97d40-bd25-4a37-b532-f1e5d6b41be7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 12:53:28.676801 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-46c97d40-bd25-4a37-b532-f1e5d6b41be7 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011867 Oct 14 12:53:28.676801 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Oct 14 12:53:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 14 12:53:29.873006 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-4e060243-8366-4e91-a855-e1e88c9e0f9a admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:29.874038 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-4e060243-8366-4e91-a855-e1e88c9e0f9a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 14 12:53:29.874429 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Oct 14 12:53:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:53:30.387753 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-cc30e053-50d4-460e-aab0-371b8564bb27 admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:30.393504 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.wsgi [None req-cc30e053-50d4-460e-aab0-371b8564bb27 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-cc30e053-50d4-460e-aab0-371b8564bb27 admin admin] Request method failure captured: Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Accept: application/json Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Accept-Encoding: gzip, deflate Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Connection: keep-alive Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Content-Length: 0 Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Host: 10.222.0.47 Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Openstack-Api-Version: compute 2.92 Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Openstack-System-Scope: None Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: User-Agent: python-novaclient Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Auth-Token: gAAAAABjSVvJJ17r11K8pbfM0mxNBDkbZbuTNeqk-nwUm75Zva1_Bm3I2UjP7Y9twsbWF-1PkUY9G59Rnau2Xafu-xMyk7x8kRm9a4m3DwyUnLUHdkfwQyL88pUb5x3vnA6uPclpmEN75jNAlP5zX57hT4tHdU82_GuncqVnrp7Htsj563NfNoo Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Domain-Id: None Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Domain-Name: None Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Identity-Status: Confirmed Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Is-Admin-Project: True Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Project-Domain-Id: default Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Project-Domain-Name: Default Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Project-Id: 48f83413dd8d497d98e9b13f0fa4b793 Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Project-Name: admin Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Role: member,reader,admin Oct 14 12:53:30.394998 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Roles: member,reader,admin Oct 14 12:53:30.396520 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_48f83413dd8d497d98e9b13f0fa4b793", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 12:53:30.396520 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Tenant: admin Oct 14 12:53:30.396520 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Tenant-Id: 48f83413dd8d497d98e9b13f0fa4b793 Oct 14 12:53:30.396520 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-Tenant-Name: admin Oct 14 12:53:30.396520 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-User: admin Oct 14 12:53:30.396520 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-User-Domain-Id: default Oct 14 12:53:30.396520 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-User-Domain-Name: Default Oct 14 12:53:30.396520 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-User-Id: ced917b9e08744f88e2078e19eb8640b Oct 14 12:53:30.396520 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: X-User-Name: admin Oct 14 12:53:30.396520 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: method: > Oct 14 12:53:30.396520 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: exception: Flavor 451 could not be found. Oct 14 12:53:30.396520 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: action_args: {'id': '451'} Oct 14 12:53:30.396520 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 12:53:30.396520 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:53:30.397353 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: ERROR nova.api.openstack.wsgi Oct 14 12:53:30.398669 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-cc30e053-50d4-460e-aab0-371b8564bb27 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103668) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 12:53:30.399888 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-cc30e053-50d4-460e-aab0-371b8564bb27 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.385027 Oct 14 12:53:30.399888 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Oct 14 12:53:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:30.406194 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-fd57fc9b-b95d-4595-bc9c-4bfd9bb4c9e3 admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:30.421309 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-fd57fc9b-b95d-4595-bc9c-4bfd9bb4c9e3 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018739 Oct 14 12:53:30.421913 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Oct 14 12:53:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 12:53:30.431678 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-433e9fcf-6b72-47c0-aaca-55246f9c4e3c admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:30.446502 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-433e9fcf-6b72-47c0-aaca-55246f9c4e3c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018951 Oct 14 12:53:30.447040 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Oct 14 12:53:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 12:53:30.455897 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-aba7e184-6c2d-4b91-9611-3983fcc199f1 admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:30.460739 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.wsgi [None req-aba7e184-6c2d-4b91-9611-3983fcc199f1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-aba7e184-6c2d-4b91-9611-3983fcc199f1 admin admin] Request method failure captured: Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Accept: application/json Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Accept-Encoding: gzip, deflate Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Connection: keep-alive Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Content-Length: 0 Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Host: 10.222.0.47 Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Openstack-Api-Version: compute 2.92 Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Openstack-System-Scope: None Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: User-Agent: python-novaclient Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Auth-Token: gAAAAABjSVvJJ17r11K8pbfM0mxNBDkbZbuTNeqk-nwUm75Zva1_Bm3I2UjP7Y9twsbWF-1PkUY9G59Rnau2Xafu-xMyk7x8kRm9a4m3DwyUnLUHdkfwQyL88pUb5x3vnA6uPclpmEN75jNAlP5zX57hT4tHdU82_GuncqVnrp7Htsj563NfNoo Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Domain-Id: None Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Domain-Name: None Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Identity-Status: Confirmed Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Is-Admin-Project: True Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Openstack-Nova-Api-Version: 2.92 Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Project-Domain-Id: default Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Project-Domain-Name: Default Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Project-Id: 48f83413dd8d497d98e9b13f0fa4b793 Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Project-Name: admin Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Role: member,reader,admin Oct 14 12:53:30.462264 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Roles: member,reader,admin Oct 14 12:53:30.463791 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/48f83413dd8d497d98e9b13f0fa4b793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_48f83413dd8d497d98e9b13f0fa4b793", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 12:53:30.463791 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Tenant: admin Oct 14 12:53:30.463791 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Tenant-Id: 48f83413dd8d497d98e9b13f0fa4b793 Oct 14 12:53:30.463791 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-Tenant-Name: admin Oct 14 12:53:30.463791 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-User: admin Oct 14 12:53:30.463791 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-User-Domain-Id: default Oct 14 12:53:30.463791 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-User-Domain-Name: Default Oct 14 12:53:30.463791 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-User-Id: ced917b9e08744f88e2078e19eb8640b Oct 14 12:53:30.463791 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: X-User-Name: admin Oct 14 12:53:30.463791 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: method: > Oct 14 12:53:30.463791 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: exception: Flavor 451 could not be found. Oct 14 12:53:30.463791 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: action_args: {'id': '451'} Oct 14 12:53:30.463791 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 12:53:30.463791 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:53:30.464784 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: ERROR nova.api.openstack.wsgi Oct 14 12:53:30.466135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-aba7e184-6c2d-4b91-9611-3983fcc199f1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 12:53:30.467336 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-aba7e184-6c2d-4b91-9611-3983fcc199f1 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011125 Oct 14 12:53:30.467545 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Oct 14 12:53:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 14 12:53:31.674898 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-433e9fcf-6b72-47c0-aaca-55246f9c4e3c admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:31.675931 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-433e9fcf-6b72-47c0-aaca-55246f9c4e3c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 14 12:53:31.676320 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Oct 14 12:53:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:53:32.199074 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-6b2c5497-bbcf-43c7-984d-d4a9bfdc57d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:53:32.218546 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-6b2c5497-bbcf-43c7-984d-d4a9bfdc57d8 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.405419 Oct 14 12:53:32.219074 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Oct 14 12:53:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 12:53:33.443061 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-433e9fcf-6b72-47c0-aaca-55246f9c4e3c admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:33.444207 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-433e9fcf-6b72-47c0-aaca-55246f9c4e3c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Oct 14 12:53:33.444631 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Oct 14 12:53:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 12:53:33.956471 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-8026172f-dbfb-4518-873b-12d408c9d701 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:53:33.974553 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-8026172f-dbfb-4518-873b-12d408c9d701 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.393558 Oct 14 12:53:33.975968 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Oct 14 12:53:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 12:53:35.192023 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-433e9fcf-6b72-47c0-aaca-55246f9c4e3c admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:35.193030 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-433e9fcf-6b72-47c0-aaca-55246f9c4e3c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Oct 14 12:53:35.193421 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Oct 14 12:53:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:53:35.708847 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-61263c36-40cf-4ba4-a543-6f95fe4df2e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:53:35.728130 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-61263c36-40cf-4ba4-a543-6f95fe4df2e5 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.398026 Oct 14 12:53:35.728675 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Oct 14 12:53:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 12:53:36.929732 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-433e9fcf-6b72-47c0-aaca-55246f9c4e3c admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:36.930733 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-433e9fcf-6b72-47c0-aaca-55246f9c4e3c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 14 12:53:36.931114 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Oct 14 12:53:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:53:37.445804 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-8085551a-e441-4c63-9b9c-e85cf8b0f288 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:53:37.464338 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-8085551a-e441-4c63-9b9c-e85cf8b0f288 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.398259 Oct 14 12:53:37.464878 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Oct 14 12:53:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 12:53:38.679376 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-433e9fcf-6b72-47c0-aaca-55246f9c4e3c admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:38.680390 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-433e9fcf-6b72-47c0-aaca-55246f9c4e3c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 14 12:53:38.680785 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Oct 14 12:53:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:53:39.199267 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-378d6d11-469f-4e59-b0e4-496761f95558 admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:53:39.219122 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-378d6d11-469f-4e59-b0e4-496761f95558 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400380 Oct 14 12:53:39.219646 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Fri Oct 14 12:53:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 12:54:35.673991 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-433e9fcf-6b72-47c0-aaca-55246f9c4e3c admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:54:35.674999 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-433e9fcf-6b72-47c0-aaca-55246f9c4e3c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 14 12:54:35.675394 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 931 bytes} [Fri Oct 14 12:54:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:54:35.686693 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG dbcounter [-] [103667] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:36.064336 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-0525125a-d795-4832-8dd4-cbab5359bd98 admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:54:36.084762 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-0525125a-d795-4832-8dd4-cbab5359bd98 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402561 Oct 14 12:54:36.085294 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1292 bytes} [Fri Oct 14 12:54:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 12:54:36.106343 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG dbcounter [-] [103668] Writing DB stats nova_api:SELECT=14 {{(pid=103668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:54:36.110542 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-32989a54-1cd2-4a7e-92f1-c419c6ced32f admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:54:36.117877 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-32989a54-1cd2-4a7e-92f1-c419c6ced32f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012933 Oct 14 12:54:36.118378 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1283 bytes} [Fri Oct 14 12:54:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 12:54:36.129473 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-25bbce7b-3097-4fd3-8f2d-660c9fe9b9a6 admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:54:36.136542 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-25bbce7b-3097-4fd3-8f2d-660c9fe9b9a6 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010535 Oct 14 12:54:36.137045 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1286 bytes} [Fri Oct 14 12:54:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 12:54:36.148553 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-a6deb2c3-fcc1-4716-b603-9f7e6eaba5fd admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:54:36.155647 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-a6deb2c3-fcc1-4716-b603-9f7e6eaba5fd admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011111 Oct 14 12:54:36.156154 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1286 bytes} [Fri Oct 14 12:54:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 12:54:36.167618 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-72db0a0a-fa65-4810-9cb2-7334eba1d2fc admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:54:36.174984 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-72db0a0a-fa65-4810-9cb2-7334eba1d2fc admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010780 Oct 14 12:54:36.175634 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1283 bytes} [Fri Oct 14 12:54:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 12:57:38.139131 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-a6deb2c3-fcc1-4716-b603-9f7e6eaba5fd admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:57:38.140140 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-a6deb2c3-fcc1-4716-b603-9f7e6eaba5fd admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 Oct 14 12:57:38.140538 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Oct 14 12:57:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:57:38.282669 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG dbcounter [-] [103667] Writing DB stats nova_api:SELECT=6 {{(pid=103667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:38.440103 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-bc0386b8-7a41-41a9-85f8-141f8391b475 admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:57:38.444760 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-bc0386b8-7a41-41a9-85f8-141f8391b475 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:57:38.445242 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-bc0386b8-7a41-41a9-85f8-141f8391b475 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:57:38.445693 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-bc0386b8-7a41-41a9-85f8-141f8391b475 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:57:38.446408 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-bc0386b8-7a41-41a9-85f8-141f8391b475 admin admin] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:57:38.446853 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-bc0386b8-7a41-41a9-85f8-141f8391b475 admin admin] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:57:38.447267 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-bc0386b8-7a41-41a9-85f8-141f8391b475 admin admin] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:57:38.478564 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-bc0386b8-7a41-41a9-85f8-141f8391b475 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197142 Oct 14 12:57:38.479110 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Oct 14 12:57:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 12:57:39.584061 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-a6deb2c3-fcc1-4716-b603-9f7e6eaba5fd admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:57:39.585109 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-a6deb2c3-fcc1-4716-b603-9f7e6eaba5fd admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 14 12:57:39.585547 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Oct 14 12:57:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:57:39.775475 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-6df045c9-7a07-42d7-bfe0-f3bc7a1dafce admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:57:39.779516 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-6df045c9-7a07-42d7-bfe0-f3bc7a1dafce admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:57:39.779992 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-6df045c9-7a07-42d7-bfe0-f3bc7a1dafce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:57:39.780421 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-6df045c9-7a07-42d7-bfe0-f3bc7a1dafce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:57:39.781135 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-6df045c9-7a07-42d7-bfe0-f3bc7a1dafce admin admin] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:57:39.781609 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-6df045c9-7a07-42d7-bfe0-f3bc7a1dafce admin admin] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:57:39.782030 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-6df045c9-7a07-42d7-bfe0-f3bc7a1dafce admin admin] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:57:39.800943 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-6df045c9-7a07-42d7-bfe0-f3bc7a1dafce admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.075851 Oct 14 12:57:39.801474 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Oct 14 12:57:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 12:57:51.266190 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-a6deb2c3-fcc1-4716-b603-9f7e6eaba5fd admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:57:51.267188 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-a6deb2c3-fcc1-4716-b603-9f7e6eaba5fd admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 14 12:57:51.267573 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Oct 14 12:57:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:57:51.411222 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG dbcounter [-] [103667] Writing DB stats nova_cell0:SELECT=4 {{(pid=103667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:51.411938 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG dbcounter [-] [103667] Writing DB stats nova_cell1:SELECT=4 {{(pid=103667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:51.412572 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG dbcounter [-] [103667] Writing DB stats nova_api:SELECT=8 {{(pid=103667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:57:51.459556 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-43e49b2e-68c2-49bc-8028-2ae97c46b07c admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:57:51.463016 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-43e49b2e-68c2-49bc-8028-2ae97c46b07c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:57:51.463487 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-43e49b2e-68c2-49bc-8028-2ae97c46b07c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:57:51.463910 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-43e49b2e-68c2-49bc-8028-2ae97c46b07c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:57:51.464647 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-43e49b2e-68c2-49bc-8028-2ae97c46b07c admin admin] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:57:51.465086 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-43e49b2e-68c2-49bc-8028-2ae97c46b07c admin admin] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:57:51.465515 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-43e49b2e-68c2-49bc-8028-2ae97c46b07c admin admin] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:57:51.490369 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-43e49b2e-68c2-49bc-8028-2ae97c46b07c admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.083514 Oct 14 12:57:51.490847 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 38/74] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Oct 14 12:57:51 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 12:57:52.558066 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG nova.api.openstack.wsgi [None req-a6deb2c3-fcc1-4716-b603-9f7e6eaba5fd admin admin] Calling method '>' {{(pid=103668) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:57:52.559071 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: INFO nova.api.openstack.requestlog [None req-a6deb2c3-fcc1-4716-b603-9f7e6eaba5fd admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 14 12:57:52.559466 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: [pid: 103668|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Oct 14 12:57:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:57:52.749299 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG nova.api.openstack.wsgi [None req-38570df0-fcbc-4194-a40c-88f777cc272b admin admin] Calling method '>' {{(pid=103667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:57:52.752668 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-38570df0-fcbc-4194-a40c-88f777cc272b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:57:52.753136 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-38570df0-fcbc-4194-a40c-88f777cc272b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:57:52.753582 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-38570df0-fcbc-4194-a40c-88f777cc272b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:57:52.754288 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-38570df0-fcbc-4194-a40c-88f777cc272b admin admin] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:57:52.754724 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-38570df0-fcbc-4194-a40c-88f777cc272b admin admin] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:57:52.755136 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: DEBUG oslo_concurrency.lockutils [None req-38570df0-fcbc-4194-a40c-88f777cc272b admin admin] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:57:52.776732 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: INFO nova.api.openstack.requestlog [None req-38570df0-fcbc-4194-a40c-88f777cc272b admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079106 Oct 14 12:57:52.777203 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: [pid: 103667|app: 0|req: 39/76] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Oct 14 12:57:52 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 12:58:50.670397 dv-cinder-820994-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 14 12:58:50.670903 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: Fri Oct 14 12:58:50 2022 - graceful shutdown triggered... Oct 14 12:58:50.671334 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: Gracefully killing worker 2 (pid: 103668)... Oct 14 12:58:50.671690 dv-cinder-820994-7-iscsi devstack@n-api.service[103667]: Gracefully killing worker 1 (pid: 103667)... Oct 14 12:58:50.797835 dv-cinder-820994-7-iscsi devstack@n-api.service[103668]: DEBUG dbcounter [-] [103668] Writing DB stats nova_api:SELECT=4 {{(pid=103668) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:58:51.671877 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: worker 1 buried after 1 seconds Oct 14 12:58:51.672429 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: worker 2 buried after 1 seconds Oct 14 12:58:51.672429 dv-cinder-820994-7-iscsi devstack@n-api.service[103666]: goodbye to uWSGI. Oct 14 12:58:51.673525 dv-cinder-820994-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 14 12:58:51.674100 dv-cinder-820994-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 14 12:58:51.676838 dv-cinder-820994-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 14 12:58:51.686834 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 14 12:58:51.688955 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 14 12:58:51 2022] *** Oct 14 12:58:51.688955 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 14 12:58:51.688955 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 14 12:58:51.688955 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: nodename: dv-cinder-820994-7-iscsi Oct 14 12:58:51.688955 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: machine: x86_64 Oct 14 12:58:51.688955 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: clock source: unix Oct 14 12:58:51.688955 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: pcre jit disabled Oct 14 12:58:51.688955 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: detected number of CPU cores: 4 Oct 14 12:58:51.688955 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: current working directory: / Oct 14 12:58:51.688955 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: detected binary path: /usr/bin/uwsgi-core Oct 14 12:58:51.688955 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: your processes number limit is 47680 Oct 14 12:58:51.689695 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: your memory page size is 4096 bytes Oct 14 12:58:51.689695 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: detected max file descriptor number: 2048 Oct 14 12:58:51.689695 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: lock engine: pthread robust mutexes Oct 14 12:58:51.689695 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: thunder lock: enabled Oct 14 12:58:51.689695 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 14 12:58:51.689695 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 14 12:58:51.729583 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: Python main interpreter initialized at 0x55e0634359c0 Oct 14 12:58:51.729583 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: python threads support enabled Oct 14 12:58:51.729583 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: your server socket listen backlog is limited to 100 connections Oct 14 12:58:51.729583 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: your mercy for graceful operations on workers is 90 seconds Oct 14 12:58:51.730044 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: mapped 403077 bytes (393 KB) for 2 cores Oct 14 12:58:51.730044 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: *** Operational MODE: preforking *** Oct 14 12:58:51.730309 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: *** uWSGI is running in multiple interpreter mode *** Oct 14 12:58:51.730309 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: spawned uWSGI master process (pid: 118855) Oct 14 12:58:51.730519 dv-cinder-820994-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 14 12:58:51.731648 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: spawned uWSGI worker 1 (pid: 118868, cores: 1) Oct 14 12:58:51.731648 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: spawned uWSGI worker 2 (pid: 118869, cores: 1) Oct 14 12:58:51.731648 dv-cinder-820994-7-iscsi devstack@n-api.service[118855]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 14 12:58:52.395455 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 12:58:52.396048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 14 12:58:53.563085 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:58:53.563085 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: from cryptography.utils import int_from_bytes Oct 14 12:58:53.563708 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:58:53.563708 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: from cryptography.utils import int_from_bytes Oct 14 12:58:53.575156 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:58:53.575156 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: from cryptography.utils import int_from_bytes Oct 14 12:58:53.575611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 14 12:58:53.575611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: from cryptography.utils import int_from_bytes Oct 14 12:58:55.969245 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 12:58:55.969855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 12:58:55.969978 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 12:58:55.970357 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 12:58:55.970612 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 12:58:55.971014 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.971343 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.971671 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.971998 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.972335 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.972653 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.973253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.973335 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.973680 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.973905 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.974231 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.974986 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-7-iscsi {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.975096 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.975356 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.975677 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.976005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.976319 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.976648 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.976959 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.977465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.983598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.983598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.983598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.983598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.983598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.983598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.983598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.983598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.984639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.984639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.984639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-7-iscsi {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.984639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.984639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.984639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.984639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.984639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.985156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.985592 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.985815 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.986149 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.986496 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.986834 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.987166 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.987496 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.987816 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.988136 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.988459 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.988787 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.989102 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.989422 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.989705 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.989811 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 14 12:58:55.992254 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.992335 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 14 12:58:55.992408 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.992494 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 14 12:58:55.992575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.992653 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 14 12:58:55.992733 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.992814 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 14 12:58:55.992900 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.992980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.993051 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.993126 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.993197 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.993274 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.993354 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.993436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.993821 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.993821 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.994108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.994265 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.994411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.994690 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.994871 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.995028 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.995780 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.995950 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.996099 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.996255 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.996409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.996574 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.996739 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.996886 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.997032 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-7-iscsi {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.997185 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.997369 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.997578 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.998297 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.998452 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.998605 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.998758 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.998914 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.999068 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.999232 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.999389 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.999552 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.999707 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:55.999853 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.000010 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.000173 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.000345 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.000492 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.000636 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.000788 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.000951 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.001098 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.001504 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.001665 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.001812 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.001970 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.002129 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.002284 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.002441 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.002587 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.002740 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.002905 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.003053 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.003205 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.003351 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.003502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.003649 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.003649 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.003954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-7-iscsi {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.004102 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.004254 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.004399 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.004557 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.004710 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.004855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.005008 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.005159 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.005306 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.005657 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.005814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.005971 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.006129 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.006281 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.006441 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.006596 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.006742 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.006893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.007039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.007185 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.007338 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.007338 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.007627 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.007773 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.007936 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.008090 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.008249 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.008404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.008549 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.008726 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.008887 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.009033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.009192 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.009349 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.009515 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.009667 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.009822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.009988 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.010134 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.010294 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.010448 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.010603 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.010756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.010910 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.011062 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.011207 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.011619 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.011783 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.011930 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.011930 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.012279 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.012431 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.012592 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.012738 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.012892 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.013045 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.013203 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.013960 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.014115 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.014268 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.014420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.014583 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.014737 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.014893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.015040 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.015195 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.015341 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.015486 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.015688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.015975 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.016142 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.016300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.016457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.016604 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.017441 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.017705 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.017858 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.018004 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.018149 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.018294 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.018465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.018612 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.018759 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.018759 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.019050 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.019050 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.019360 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.019514 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.019667 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.019822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.019969 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.019969 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.020268 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.020424 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.020576 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.020722 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.020876 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.021022 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.021183 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.021183 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.021771 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.021940 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.022095 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.022257 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.022403 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.022548 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.022700 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.022845 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.022999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.023916 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.024121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.024308 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.024567 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.024722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.024869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.025030 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.025177 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.025322 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.025467 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.025678 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.025678 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.025981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.026128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.026273 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.026428 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.026574 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.026729 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.026875 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.027021 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.027175 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.027327 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.027484 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.027647 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.027802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.027947 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.028098 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.028244 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.028399 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.028557 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.028703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.028894 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.028894 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.029188 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.029334 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.029580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.029745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.029900 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.030052 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.030201 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.030361 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.030526 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.030672 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.030818 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.030973 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.031119 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.031273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.031429 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.031575 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.031948 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.032836 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.032998 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.033153 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.033300 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.033458 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.033651 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.033808 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.033955 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.034101 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.034246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.034399 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.034561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.034715 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.034869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.035024 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.035178 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.035341 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.035500 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.035647 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.035842 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.035995 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.036148 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.036303 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.036457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.036603 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.036764 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.036920 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.037073 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.037219 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.037385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.037583 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.037583 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.037983 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.038142 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.038296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.038454 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.038600 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.038754 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.038911 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.039056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.039207 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.039363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.039527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.039682 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.039828 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.039980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.040148 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.040305 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.040451 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.040603 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.040751 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.040896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 14 12:58:56.041042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.041196 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.041343 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.041343 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.041663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.042024 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.042193 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.042341 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.042487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.042639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.042786 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.042934 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.043094 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.043241 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.043392 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.043557 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.043703 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.043849 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.044004 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.044166 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.044312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.044458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.044609 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.044765 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.044949 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.045103 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.045257 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.045473 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.045858 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.046095 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.046261 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.046481 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.046630 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.046784 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.046930 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.047094 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.047240 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.047386 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.047531 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.047684 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.047841 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.048008 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.048156 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.048302 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.048455 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.048608 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.048767 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.048914 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.049068 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.049221 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.049377 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.049542 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.049721 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.049884 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.050030 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.050176 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.050331 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.050477 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.050633 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.050786 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.050932 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.051078 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.051233 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.051379 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.051539 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.051685 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.051847 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.052020 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.052178 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.052178 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.052471 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.052633 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.053120 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.053281 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.053439 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.053626 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.053775 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.053929 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.054076 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.054240 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.054396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.054396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.054691 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.054838 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.054983 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.055137 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.055290 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.055453 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.055600 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.055745 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.055891 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.056036 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.056200 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.056347 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.056501 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.056655 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.056807 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.056961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.057115 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.057269 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.057415 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.057601 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.057762 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.057909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.058068 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.058224 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.058370 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.058370 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.058662 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.058808 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.058968 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.059114 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.059268 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.059413 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.059559 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.059704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.059859 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.060023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.060704 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.060865 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.061020 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.061180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.061327 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.061472 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.061653 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.061801 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.061948 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.062108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.062255 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.062400 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.062556 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.062702 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.062855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.063015 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.063170 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.063317 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.063469 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.063622 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.063769 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.063929 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.064083 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.064229 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.064382 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.064538 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.064693 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.064841 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.064988 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.065132 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.065287 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.065439 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.065692 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.065856 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.066010 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.066171 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.066332 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.066484 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.066660 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.066821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.066984 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.067144 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.067297 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.067449 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.067615 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.067768 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.067921 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.068081 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.068234 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.068397 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.068560 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.068720 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.068873 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.069026 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.069189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.069356 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.069532 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.069691 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.069854 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.070007 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.070160 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.070322 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.070651 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.070835 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.070997 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.071159 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.071311 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.071473 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.071625 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.071783 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.071942 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.072094 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.072257 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.072416 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.072575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.072727 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.072897 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.073049 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.073219 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.073381 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.073593 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.073765 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.073926 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.074079 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.074246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.074399 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.074551 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.074710 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.074869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.075032 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.075193 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.075346 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.075497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.075656 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.075843 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.076580 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.076895 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.077046 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.077197 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.077349 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.077557 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.077717 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.077869 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.078028 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.078187 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.078346 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.078512 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.078671 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.078828 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.078980 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.079130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.079282 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.079441 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.079611 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.079763 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.079922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.080080 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.080232 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.080410 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.080565 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.080722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.080975 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.081131 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.081298 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.081459 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.081663 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.081837 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.081998 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.082149 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.082309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.082468 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.082621 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.082773 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.082924 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.083083 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.083245 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.083405 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.083564 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.083717 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.083885 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.084038 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.084203 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.084355 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.084516 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.084667 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.084826 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.084991 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.085142 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.085293 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.085451 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.085644 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.085807 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.086016 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.086174 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.086325 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.086476 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.086628 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.086787 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.086950 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.087102 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.087261 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.087421 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.087580 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.087733 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.087893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.088057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.088209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.088360 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.088517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.088682 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.088841 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.088841 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.089130 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.089281 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.089440 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.089655 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.089809 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.089971 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.090131 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.090283 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.090434 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.090598 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.090769 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.090922 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.091083 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.091234 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.091415 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.091571 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.091731 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.091882 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.092053 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.092219 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.092378 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.092530 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.092689 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.092841 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.093228 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.093392 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.093580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.093732 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.093910 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.094193 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.094343 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.094483 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.094622 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.094737 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.094859 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.094988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.095101 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.095304 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.095439 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.095579 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.095717 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.095849 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.095969 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.096114 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.096251 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.096382 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.096522 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.096663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.096809 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.096948 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.097077 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.097219 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.097352 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.097510 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.097656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.097796 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.097923 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.098043 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.098170 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.098309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.098441 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.098571 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.098710 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.098843 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.098988 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.099131 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.099263 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.099402 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.099536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.099673 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.099986 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.100132 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.100264 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.100395 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.100528 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.100673 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.100818 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.100957 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.101088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.101208 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.101346 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.101554 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.101702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.101834 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.101965 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.102104 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.102227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.102227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.102512 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.102512 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.102951 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.103091 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.103223 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.103368 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.103565 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.103707 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.103837 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.103974 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.104111 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.104255 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.104392 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.104522 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.104650 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.104787 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.104931 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.105061 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.105189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.105189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.105445 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.105608 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.105752 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.105884 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.106014 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.106145 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.106275 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.106406 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.106550 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.106672 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.106672 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.106937 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.107091 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.107222 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.107362 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.107501 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.107639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.107785 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.107925 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.108056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.108194 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.108333 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.108479 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.108623 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.108755 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.109135 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.109267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.109398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.109559 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.109705 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.109837 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.109969 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.110100 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.110240 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.110381 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.110513 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.110644 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.110785 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.110916 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.111056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.111200 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.111340 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.111470 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.111601 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.111740 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.111871 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.112015 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.112147 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.112320 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.112461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.112593 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.112722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.112862 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.113000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.113140 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.113271 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.113400 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.113558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.113692 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.113823 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.113953 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.114090 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.114223 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.114367 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.114499 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.114636 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.114777 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.114909 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.115047 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.115189 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.115327 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.115466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.115604 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.115743 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.115873 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.116014 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.116145 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.116277 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.116407 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.116546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.116687 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.116826 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.116957 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.117095 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.117234 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.117366 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.117550 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.117695 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.117828 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.117966 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.118097 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.118306 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.118526 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.118668 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.118800 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.118930 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.119068 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.119210 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.119355 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.119502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.119634 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.119765 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.119895 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.120036 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.120168 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.120299 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.120431 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.120571 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.120720 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.120860 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.120860 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.121116 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.121255 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.121394 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.121558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.121707 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.121846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.121985 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.122116 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.122254 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.122398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.122532 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.123163 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.123297 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.123428 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.123567 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.123713 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.123845 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.123984 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.124147 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.124279 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.124424 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.124570 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.124711 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.124851 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.124982 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.125149 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.125327 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.125460 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.125642 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.125774 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.125915 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.126055 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.126233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.126376 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.126509 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.126640 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.126772 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.126910 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.127050 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.127182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.127344 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.127477 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.127615 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.127757 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.127971 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.128105 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.128244 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.128383 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.128522 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.128667 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.128808 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.128942 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.129072 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.129210 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.129389 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.129557 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.129700 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.129837 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.129968 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.130104 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.130233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.130371 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.130500 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.130636 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.130769 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.130899 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.131042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.131180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.131316 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.131481 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.131616 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.131755 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.131755 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.132020 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.132160 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.132299 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.132299 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.132547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.132547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.132809 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.132809 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.133065 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.133197 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.133335 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.133523 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.133657 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.133789 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.133918 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.134062 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.134203 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.134342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.134473 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.134604 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.134741 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.134878 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.135018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.135158 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.135289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.135427 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.135588 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.135588 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.135851 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.135983 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.136120 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.136252 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.136391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.136522 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.136665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.136798 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.136928 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.137067 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.137199 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.137338 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.137494 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.137639 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.137762 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.137891 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.138029 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.138172 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.138960 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.139085 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.139215 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.139346 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.139477 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.139623 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.139789 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.139927 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.140059 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.140197 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.140329 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.140623 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.140766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.140915 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.141049 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.141182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.141313 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.141456 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.141621 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.141752 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.141883 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.142104 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.142256 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.142399 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.142399 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.142659 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.142792 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.142930 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.143077 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.143209 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.143349 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.143483 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.143622 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.143793 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.143935 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.144068 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.144200 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.144340 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.144480 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.144623 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.144623 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.144872 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.145004 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.145143 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.145275 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.145420 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.145613 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.145771 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.145904 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.146049 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.146190 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.146331 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.146478 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.146670 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.146804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.146985 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.147119 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.147264 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.147397 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.147536 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.147669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.147843 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.147980 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.148112 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.148243 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.148374 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.148513 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.148655 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.148790 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.148936 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.149069 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.149201 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.149333 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.149530 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.149677 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.149820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.149960 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.150093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.150223 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.150355 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.150494 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.150634 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.150782 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.150917 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.151057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.151190 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.151321 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.151461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.151600 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.151600 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.151896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.152038 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.152178 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.152178 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.152437 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.152437 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.152704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.152845 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.152986 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.153131 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.153264 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.153475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.153628 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.153761 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.153913 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.154057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.154190 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.154331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.154463 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.154594 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.154725 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.154856 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.154987 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.155129 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.155262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.155394 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.155532 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.155665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.155797 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.155944 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.156094 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.156234 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.156374 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.156507 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.156652 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.156791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.156939 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.157071 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.157204 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.157336 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.157490 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.157629 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.157629 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.157886 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.158020 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.158160 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.158894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.159035 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.159174 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.159309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.159442 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.159589 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.159722 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.159862 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.160036 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.160178 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.160312 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.160518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.160660 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.160797 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.160928 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.161068 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.161200 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.161348 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.161552 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.161700 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.161846 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.161980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.162112 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.162253 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.162387 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.162520 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.162647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.162762 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.162876 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.163020 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.163154 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.163293 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.163427 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.163566 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.163566 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.163837 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.163970 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.164109 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.164248 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.164380 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.164523 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.164655 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.164786 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.164925 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.165057 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.165194 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.165340 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.165473 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.165954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.166102 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.166256 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.166388 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.166531 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.166673 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.166805 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.166937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.167069 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.167209 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.167342 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.167481 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.167623 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.167756 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.167887 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.168062 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.168199 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.168332 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.168472 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.168604 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.168749 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.168882 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.169022 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.169154 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.169293 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.169433 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.169628 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.169763 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.169904 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.170037 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.170176 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.170322 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.170464 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.170606 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.170797 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.170940 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.171081 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.171224 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.171370 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.171502 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.171641 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.171773 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.171913 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.172054 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.172194 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.172325 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.172465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.172597 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.172736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.172883 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.173024 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.173156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.173287 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.173419 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.173577 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.173720 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.173854 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.173987 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.174125 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.174257 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.174398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.174543 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.174673 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.174805 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.174943 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.174943 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.175215 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.175348 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.175486 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.175618 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.175749 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.175880 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.176021 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.176192 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.176324 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.176464 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.176604 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.176745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.176893 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.177435 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.177624 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.177771 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.177905 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.178051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.178185 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.178325 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.178457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.178597 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.178737 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.178878 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.179017 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.179151 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.179282 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.179413 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.179544 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.179544 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.179803 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.179942 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.180089 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.180230 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.180363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.180363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.180631 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.180779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.180972 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.181106 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.181248 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.181388 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.181535 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.181680 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.181821 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.181960 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.182100 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.182241 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.182383 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.182516 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.182648 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.182779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.182924 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.183057 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.183189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.183329 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.183461 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.183606 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.183747 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.183879 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.184001 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.184138 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.184318 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.184461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.184602 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.184745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.184885 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.185025 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.185787 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.185925 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.186057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.186190 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.186321 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.186462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.186605 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.186745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.186878 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.187019 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.187151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.187283 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.187492 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.187636 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.187769 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.187891 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.188021 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.188153 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.188298 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.188438 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.188572 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.188711 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.188851 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.188997 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.189130 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.189130 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.189386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.189386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.190242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.190397 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.190546 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.190689 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.190822 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.190962 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.191099 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.191246 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.191386 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.191526 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.191666 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.191666 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.191926 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.192071 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.192204 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.192336 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.192466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.192598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.192742 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.192888 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.193022 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.193154 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.193293 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.193433 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.193615 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.193750 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.193883 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.194022 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.194154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.194275 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.194418 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.194418 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.194676 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.194808 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.194944 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.195094 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.195234 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.195366 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.195498 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.195637 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.195769 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.195911 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.196044 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.196190 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.196331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.196464 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.196603 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.196603 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.196870 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.197011 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.197152 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.197293 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.197426 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.197587 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.197730 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.197863 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.197994 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.198115 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.198255 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.198388 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.198519 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.198658 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.198799 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.198938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.199080 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.199213 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.199351 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.199488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.199634 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.199774 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.199915 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.200054 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.200188 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.200352 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.200484 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.200615 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.200796 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.201442 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.201606 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.201737 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.201853 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.201975 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.202096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.202219 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.202331 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.202444 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.202584 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.202730 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.202870 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.203002 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.203142 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.203284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.203425 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.203565 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.203697 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.203828 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.203959 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.204089 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.204229 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.204415 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.204553 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.204736 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.204873 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.205047 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.205191 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.205374 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.205572 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.205801 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.205936 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.206120 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.206265 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.206440 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.206583 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.206751 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.206885 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.207077 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.207226 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.207402 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.207544 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.207713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.207855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.208031 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.208165 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.208342 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.208478 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.208665 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.208801 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.208983 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.209132 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.209312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.209455 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.209659 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.209804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.209979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.210115 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.210285 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.210420 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.210597 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.210743 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.210913 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.211173 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.211314 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.211517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.211653 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.211835 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.211969 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.212141 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.212284 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.212449 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.212586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.212728 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.212861 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.213032 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.213167 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.213337 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.213543 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.213691 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.213827 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.213967 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.214107 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.214240 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.214380 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.214547 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.214690 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.214854 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.214997 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.215161 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.215369 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.215504 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.215643 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.215775 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.215907 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.216045 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.216187 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.216368 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.216503 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.216657 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.216802 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.216949 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.217089 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.217253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.217388 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.217582 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.217729 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.217918 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.218064 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.218253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.218389 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.218573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.218713 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.218899 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.219037 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.219213 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.219393 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.219535 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.219676 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.219818 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.219951 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.220140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.220274 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.220459 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.220608 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.220772 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.220915 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.221085 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.221228 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.221410 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.221579 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.221767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.221908 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.222084 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.222233 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.222374 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.222524 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.222699 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.222833 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.223013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.223149 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.223327 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.223471 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.223656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.223805 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.223985 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.224129 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.224298 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.224442 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.224623 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.224768 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.224946 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.225091 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.225269 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.225404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.225609 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.225744 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.225926 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.226077 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.226258 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.226395 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.226573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.226709 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.226888 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.227033 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.227203 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.227339 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.227510 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.227653 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.227822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.227970 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.228136 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.228270 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.228449 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.228585 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.228763 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.228898 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.229075 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.229217 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.229382 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.229537 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.229721 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.229858 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.230032 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.230167 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.230341 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.230477 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.230649 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.230792 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.230959 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.231095 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.231273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.231408 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.231580 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.231724 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.231888 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.232050 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.232222 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.232371 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.232531 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.232673 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.232806 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.232938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.233114 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.233266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.233408 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118868) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 12:58:56.233587 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.233750 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.234319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.234626 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.234936 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.235243 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.235579 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.235920 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.236249 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.236575 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.236890 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.237216 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.237550 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.237880 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.238207 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.238528 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.238844 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.239181 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.239496 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.239873 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.240131 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.240447 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.240762 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.241076 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.241408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.241764 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.242160 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.242404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.242730 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.243057 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.243377 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.243694 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.244027 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.244343 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.244660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.244974 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.245290 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.245631 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.245953 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.246271 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.246585 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.246907 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.247227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.247557 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.248398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.248713 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.249043 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.249375 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.249766 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.250087 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.250438 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.250770 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.251089 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.251407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.251718 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 14 12:58:56.251964 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 14 12:58:56.295831 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO dbcounter [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] Registered counter for database nova_api Oct 14 12:58:56.314815 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO dbcounter [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] Registered counter for database nova_api Oct 14 12:58:56.316973 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_db.sqlalchemy.engines [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:58:56.323516 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writer thread running {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:58:56.335477 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_db.sqlalchemy.engines [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:58:56.342218 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writer thread running {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:58:56.380124 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.context [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),855abc56-36ec-427f-934f-3735e458a612(cell1) {{(pid=118868) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 12:58:56.384158 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:58:56.384632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:58:56.386248 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:58:56.386982 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:58:56.387429 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:58:56.390039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:58:56.392028 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO dbcounter [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] Registered counter for database nova_cell0 Oct 14 12:58:56.396081 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO dbcounter [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] Registered counter for database nova_cell1 Oct 14 12:58:56.399276 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.context [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),855abc56-36ec-427f-934f-3735e458a612(cell1) {{(pid=118869) load_cells /opt/stack/nova/nova/context.py:464}} Oct 14 12:58:56.403397 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:58:56.403562 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_db.sqlalchemy.engines [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:58:56.403916 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:58:56.405569 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:58:56.405722 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_db.sqlalchemy.engines [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:58:56.406331 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:58:56.406783 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:58:56.408852 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:58:56.410960 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO dbcounter [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] Registered counter for database nova_cell0 Oct 14 12:58:56.411284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writer thread running {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:58:56.413363 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writer thread running {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:58:56.415139 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO dbcounter [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] Registered counter for database nova_cell1 Oct 14 12:58:56.424948 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_db.sqlalchemy.engines [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:58:56.426236 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_db.sqlalchemy.engines [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:58:56.434142 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writer thread running {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:58:56.434478 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writer thread running {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:58:56.563796 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO dbcounter [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] Registered counter for database nova_cell0 Oct 14 12:58:56.570424 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_db.sqlalchemy.engines [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118868) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:58:56.575173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writer thread running {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:58:56.586235 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO dbcounter [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] Registered counter for database nova_cell0 Oct 14 12:58:56.593840 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_db.sqlalchemy.engines [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 14 12:58:56.598498 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writer thread running {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 14 12:58:56.896897 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: WARNING keystonemiddleware.auth_token [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 12:58:56.904836 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: WARNING keystonemiddleware.auth_token [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 12:58:56.924929 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: WARNING keystonemiddleware.auth_token [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 12:58:56.932664 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: WARNING keystonemiddleware.auth_token [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 12:58:57.252992 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: WARNING keystonemiddleware.auth_token [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 12:58:57.259406 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: WARNING keystonemiddleware.auth_token [None req-0e6059eb-cfec-45ed-81ac-f18a62398e41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 12:58:57.264973 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0634359c0 pid: 118868 (default app) Oct 14 12:58:57.292074 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: WARNING keystonemiddleware.auth_token [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 14 12:58:57.298158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: WARNING keystonemiddleware.auth_token [None req-271ed7d5-f095-4eee-8c52-d17362d99360 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 14 12:58:57.303708 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0634359c0 pid: 118869 (default app) Oct 14 12:59:31.150899 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=3 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:31.152080 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=3 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:31.153058 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=3 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:31.154018 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=3 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:32.186458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-607ad090-3124-4691-bd9e-9ee8a250adc2 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Action: 'create', calling method: .version_select at 0x7fbb82add4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1730394977", "metadata": {"Type": "work"}}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-607ad090-3124-4691-bd9e-9ee8a250adc2 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Request method failure captured: Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 122 Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV0z--_sZyftaCwM1Ee38Q4AhaonviYkhuMEDKK6a491xRkdWUgN5vaL5wkj0llOWTXyQVmDuAJkpUOrIKPFcWQLn4_iR-_jK7ygH0z2SANoEIVDKj878YQv9jEBBXYo_4bJTtUq20c6G31Oayd7yIpEEdvv5Kz--g6IycBOhVBl9Yw Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: d108f710c68845a8b01b30a67183a4a0 Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 12:59:32.192396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 12:59:32.193855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d108f710c68845a8b01b30a67183a4a0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 12:59:32.193855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:32.193855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: d108f710c68845a8b01b30a67183a4a0 Oct 14 12:59:32.193855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:32.193855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-VolumesNegativeTest-534656690-project Oct 14 12:59:32.193855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 12:59:32.193855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 12:59:32.193855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: fdc206c2cdca4686b297459f6ab1db75 Oct 14 12:59:32.193855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-VolumesNegativeTest-534656690-project Oct 14 12:59:32.193855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Oct 14 12:59:32.193855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1730394977", "metadata": {"Type": "work"}}} Oct 14 12:59:32.193855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: Oct 14 12:59:32.193855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1730394977', 'metadata': {'Type': 'work'}}}} Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise error Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi '#$%' Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 12:59:32.194795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 14 12:59:32.196155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 14 12:59:32.197359 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 14 12:59:32.197359 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.197359 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-607ad090-3124-4691-bd9e-9ee8a250adc2 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 12:59:32.197359 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-607ad090-3124-4691-bd9e-9ee8a250adc2 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.052413 Oct 14 12:59:32.197359 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1156 bytes} [Fri Oct 14 12:59:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1054 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 12:59:32.206431 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=3 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:32.207304 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=3 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:32.208270 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=3 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:32.209151 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=3 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 12:59:32.427647 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d45ac9cc-c24c-4caa-8e80-42f80c625612 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Action: 'create', calling method: .version_select at 0x7fbb82b260d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1780681684", "metadata": {"Type": "work"}}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d45ac9cc-c24c-4caa-8e80-42f80c625612 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Request method failure captured: Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 120 Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV0z--_sZyftaCwM1Ee38Q4AhaonviYkhuMEDKK6a491xRkdWUgN5vaL5wkj0llOWTXyQVmDuAJkpUOrIKPFcWQLn4_iR-_jK7ygH0z2SANoEIVDKj878YQv9jEBBXYo_4bJTtUq20c6G31Oayd7yIpEEdvv5Kz--g6IycBOhVBl9Yw Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: d108f710c68845a8b01b30a67183a4a0 Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 12:59:32.435946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 12:59:32.437180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d108f710c68845a8b01b30a67183a4a0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 12:59:32.437180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:32.437180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: d108f710c68845a8b01b30a67183a4a0 Oct 14 12:59:32.437180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:32.437180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-VolumesNegativeTest-534656690-project Oct 14 12:59:32.437180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 12:59:32.437180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 12:59:32.437180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: fdc206c2cdca4686b297459f6ab1db75 Oct 14 12:59:32.437180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-VolumesNegativeTest-534656690-project Oct 14 12:59:32.437180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Oct 14 12:59:32.437180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1780681684", "metadata": {"Type": "work"}}} Oct 14 12:59:32.437180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: Oct 14 12:59:32.437180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1780681684', 'metadata': {'Type': 'work'}}}} Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise error Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi '0' Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 12:59:32.439832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 14 12:59:32.441122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 14 12:59:32.442278 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 14 12:59:32.442278 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.442278 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d45ac9cc-c24c-4caa-8e80-42f80c625612 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 12:59:32.442278 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-d45ac9cc-c24c-4caa-8e80-42f80c625612 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.234162 Oct 14 12:59:32.442278 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 1/2] 10.222.0.47 () {60 vars in 1156 bytes} [Fri Oct 14 12:59:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 241 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 12:59:32.450819 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4e785ed6-ea75-489b-9c3f-a4083437f510 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Action: 'create', calling method: .version_select at 0x7fbb82adddc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1139378795", "metadata": {"Type": "work"}}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4e785ed6-ea75-489b-9c3f-a4083437f510 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Request method failure captured: Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 119 Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV0z--_sZyftaCwM1Ee38Q4AhaonviYkhuMEDKK6a491xRkdWUgN5vaL5wkj0llOWTXyQVmDuAJkpUOrIKPFcWQLn4_iR-_jK7ygH0z2SANoEIVDKj878YQv9jEBBXYo_4bJTtUq20c6G31Oayd7yIpEEdvv5Kz--g6IycBOhVBl9Yw Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: d108f710c68845a8b01b30a67183a4a0 Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 12:59:32.457580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 12:59:32.459057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d108f710c68845a8b01b30a67183a4a0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 12:59:32.459057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:32.459057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: d108f710c68845a8b01b30a67183a4a0 Oct 14 12:59:32.459057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:32.459057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-VolumesNegativeTest-534656690-project Oct 14 12:59:32.459057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 12:59:32.459057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 12:59:32.459057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: fdc206c2cdca4686b297459f6ab1db75 Oct 14 12:59:32.459057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-VolumesNegativeTest-534656690-project Oct 14 12:59:32.459057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Oct 14 12:59:32.459057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1139378795", "metadata": {"Type": "work"}}} Oct 14 12:59:32.459057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: Oct 14 12:59:32.459057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1139378795', 'metadata': {'Type': 'work'}}}} Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise error Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi '' Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 12:59:32.460205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 14 12:59:32.461874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 14 12:59:32.463269 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 14 12:59:32.463269 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:32.464158 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4e785ed6-ea75-489b-9c3f-a4083437f510 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 12:59:32.467085 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4e785ed6-ea75-489b-9c3f-a4083437f510 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022710 Oct 14 12:59:32.467992 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 2/3] 10.222.0.47 () {60 vars in 1156 bytes} [Fri Oct 14 12:59:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 12:59:32.479493 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a3c12055-2c80-45cf-9771-2b3bed7e4db6 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Calling method '.version_select at 0x7fbb82b26d30>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:59:34.587635 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-a3c12055-2c80-45cf-9771-2b3bed7e4db6 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] HTTP exception thrown: Volume tempest-invalid-2064844519 could not be found. Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a3c12055-2c80-45cf-9771-2b3bed7e4db6 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Request method failure captured: Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2064844519 HTTP/1.1 Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV0z--_sZyftaCwM1Ee38Q4AhaonviYkhuMEDKK6a491xRkdWUgN5vaL5wkj0llOWTXyQVmDuAJkpUOrIKPFcWQLn4_iR-_jK7ygH0z2SANoEIVDKj878YQv9jEBBXYo_4bJTtUq20c6G31Oayd7yIpEEdvv5Kz--g6IycBOhVBl9Yw Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: d108f710c68845a8b01b30a67183a4a0 Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 12:59:34.592157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 12:59:34.593504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d108f710c68845a8b01b30a67183a4a0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 12:59:34.593504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:34.593504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: d108f710c68845a8b01b30a67183a4a0 Oct 14 12:59:34.593504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:34.593504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-VolumesNegativeTest-534656690-project Oct 14 12:59:34.593504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 12:59:34.593504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 12:59:34.593504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: fdc206c2cdca4686b297459f6ab1db75 Oct 14 12:59:34.593504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-VolumesNegativeTest-534656690-project Oct 14 12:59:34.593504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: Oct 14 12:59:34.593504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Volume tempest-invalid-2064844519 could not be found. Oct 14 12:59:34.593504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': 'tempest-invalid-2064844519'} Oct 14 12:59:34.593504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2064844519 could not be found. (HTTP 404) (Request-ID: req-932181da-a19e-4847-bc6a-17c5c09ea489) Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:59:34.594398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 12:59:34.595558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2064844519 could not be found. Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 12:59:34.596681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2064844519 could not be found. Oct 14 12:59:34.597901 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:34.597901 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:59:34.597901 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:34.597901 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:34.597901 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:59:34.597901 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:59:34.597901 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 12:59:34.597901 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 12:59:34.597901 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2064844519 could not be found. Oct 14 12:59:34.597901 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:34.600587 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a3c12055-2c80-45cf-9771-2b3bed7e4db6 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Returning 404 to user: Volume tempest-invalid-2064844519 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 12:59:34.601764 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-a3c12055-2c80-45cf-9771-2b3bed7e4db6 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2064844519" status: 404 len: 99 microversion: 2.1 time: 2.127239 Oct 14 12:59:34.602518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1218 bytes} [Fri Oct 14 12:59:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2064844519 => generated 99 bytes in 2129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 14 12:59:34.615273 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ca2e11c9-c80d-48e5-9ee9-84c6ac571685 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003988 Oct 14 12:59:34.616316 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 3/5] 10.222.0.47 () {58 vars in 1140 bytes} [Fri Oct 14 12:59:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 14 12:59:34.628609 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-97283660-e771-46eb-b881-93eccb2fdf69 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004839 Oct 14 12:59:34.629753 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 3/6] 10.222.0.47 () {58 vars in 1137 bytes} [Fri Oct 14 12:59:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 14 12:59:34.641181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-66e33bd9-fdc4-4e5d-ab93-fe4beee76abf tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Calling method '.version_select at 0x7fbb8299d430>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:59:35.867816 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-66e33bd9-fdc4-4e5d-ab93-fe4beee76abf tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] HTTP exception thrown: Volume f0f82c35-620b-4e7e-a412-f757dd673962 could not be found. Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-66e33bd9-fdc4-4e5d-ab93-fe4beee76abf tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Request method failure captured: Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: DELETE /compute/v2.1/os-volumes/f0f82c35-620b-4e7e-a412-f757dd673962 HTTP/1.1 Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV0z--_sZyftaCwM1Ee38Q4AhaonviYkhuMEDKK6a491xRkdWUgN5vaL5wkj0llOWTXyQVmDuAJkpUOrIKPFcWQLn4_iR-_jK7ygH0z2SANoEIVDKj878YQv9jEBBXYo_4bJTtUq20c6G31Oayd7yIpEEdvv5Kz--g6IycBOhVBl9Yw Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: d108f710c68845a8b01b30a67183a4a0 Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 12:59:35.872404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 12:59:35.873981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d108f710c68845a8b01b30a67183a4a0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 12:59:35.873981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:35.873981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: d108f710c68845a8b01b30a67183a4a0 Oct 14 12:59:35.873981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:35.873981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-VolumesNegativeTest-534656690-project Oct 14 12:59:35.873981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 12:59:35.873981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 12:59:35.873981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: fdc206c2cdca4686b297459f6ab1db75 Oct 14 12:59:35.873981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-VolumesNegativeTest-534656690-project Oct 14 12:59:35.873981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: Oct 14 12:59:35.873981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Volume f0f82c35-620b-4e7e-a412-f757dd673962 could not be found. Oct 14 12:59:35.873981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': 'f0f82c35-620b-4e7e-a412-f757dd673962'} Oct 14 12:59:35.873981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f0f82c35-620b-4e7e-a412-f757dd673962 could not be found. (HTTP 404) (Request-ID: req-818014e5-7529-4cbe-b0ba-81d5f6d75e7b) Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:59:35.874945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 12:59:35.876802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f0f82c35-620b-4e7e-a412-f757dd673962 could not be found. Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 14 12:59:35.879005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 12:59:35.881181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f0f82c35-620b-4e7e-a412-f757dd673962 could not be found. Oct 14 12:59:35.881181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:35.881181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:59:35.881181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:35.881181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:35.881181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:59:35.881181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:59:35.881181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 12:59:35.881181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 12:59:35.881181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f0f82c35-620b-4e7e-a412-f757dd673962 could not be found. Oct 14 12:59:35.881181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 12:59:35.881181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-66e33bd9-fdc4-4e5d-ab93-fe4beee76abf tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Returning 404 to user: Volume f0f82c35-620b-4e7e-a412-f757dd673962 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 12:59:35.881181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-66e33bd9-fdc4-4e5d-ab93-fe4beee76abf tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/f0f82c35-620b-4e7e-a412-f757dd673962" status: 404 len: 109 microversion: 2.1 time: 1.240976 Oct 14 12:59:35.881181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Oct 14 12:59:34 2022] DELETE /compute/v2.1/os-volumes/f0f82c35-620b-4e7e-a412-f757dd673962 => generated 109 bytes in 1245 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 12:59:35.891497 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cae4ab33-d72d-4265-8ff4-292d2b3909d1 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Calling method '.version_select at 0x7fbb829168b0>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:59:36.097425 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-cae4ab33-d72d-4265-8ff4-292d2b3909d1 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] HTTP exception thrown: Volume 023da1e7-9033-4c1a-8e65-baa52ae5d67a could not be found. Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cae4ab33-d72d-4265-8ff4-292d2b3909d1 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Request method failure captured: Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: GET /compute/v2.1/os-volumes/023da1e7-9033-4c1a-8e65-baa52ae5d67a HTTP/1.1 Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV0z--_sZyftaCwM1Ee38Q4AhaonviYkhuMEDKK6a491xRkdWUgN5vaL5wkj0llOWTXyQVmDuAJkpUOrIKPFcWQLn4_iR-_jK7ygH0z2SANoEIVDKj878YQv9jEBBXYo_4bJTtUq20c6G31Oayd7yIpEEdvv5Kz--g6IycBOhVBl9Yw Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: d108f710c68845a8b01b30a67183a4a0 Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 12:59:36.099663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 12:59:36.101051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d108f710c68845a8b01b30a67183a4a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d108f710c68845a8b01b30a67183a4a0", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 12:59:36.101051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:36.101051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: d108f710c68845a8b01b30a67183a4a0 Oct 14 12:59:36.101051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-VolumesNegativeTest-534656690 Oct 14 12:59:36.101051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-VolumesNegativeTest-534656690-project Oct 14 12:59:36.101051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 12:59:36.101051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 12:59:36.101051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: fdc206c2cdca4686b297459f6ab1db75 Oct 14 12:59:36.101051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-VolumesNegativeTest-534656690-project Oct 14 12:59:36.101051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: Oct 14 12:59:36.101051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Volume 023da1e7-9033-4c1a-8e65-baa52ae5d67a could not be found. Oct 14 12:59:36.101051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '023da1e7-9033-4c1a-8e65-baa52ae5d67a'} Oct 14 12:59:36.101051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 023da1e7-9033-4c1a-8e65-baa52ae5d67a could not be found. (HTTP 404) (Request-ID: req-16ff9cff-26c1-4021-9c0b-038cba086198) Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:59:36.101906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 12:59:36.103056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 023da1e7-9033-4c1a-8e65-baa52ae5d67a could not be found. Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 12:59:36.104154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 12:59:36.105465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 023da1e7-9033-4c1a-8e65-baa52ae5d67a could not be found. Oct 14 12:59:36.105465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:36.105465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 12:59:36.105465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:36.105465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 12:59:36.105465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 12:59:36.105465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 12:59:36.105465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 12:59:36.105465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 12:59:36.105465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 023da1e7-9033-4c1a-8e65-baa52ae5d67a could not be found. Oct 14 12:59:36.105465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 12:59:36.107601 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cae4ab33-d72d-4265-8ff4-292d2b3909d1 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] Returning 404 to user: Volume 023da1e7-9033-4c1a-8e65-baa52ae5d67a could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 12:59:36.108800 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-cae4ab33-d72d-4265-8ff4-292d2b3909d1 tempest-VolumesNegativeTest-534656690 tempest-VolumesNegativeTest-534656690-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/023da1e7-9033-4c1a-8e65-baa52ae5d67a" status: 404 len: 109 microversion: 2.1 time: 0.221766 Oct 14 12:59:36.109918 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Oct 14 12:59:35 2022] GET /compute/v2.1/os-volumes/023da1e7-9033-4c1a-8e65-baa52ae5d67a => generated 109 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 12:59:47.069859 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-973902971", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:59:47.322039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.network.neutron [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] validate_networks() for [('71d7f67c-efcc-4a77-8c43-10bba17af0b2', None, None, None, None, None)] {{(pid=118868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 12:59:49.999595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Flavor limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 12:59:50.002203 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Image limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 12:59:50.003649 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Flavor pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 12:59:50.004625 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Image pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 12:59:50.006557 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 12:59:50.048388 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d4132fc2-9f58-4870-b0e0-e94eddf044d8 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Action: 'create', calling method: .version_select at 0x7fbb833079d0>, body: {"keypair": {"name": "tempest-keypair-246404629", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5TVmbbENdql1d4vPZhcRw0WH0XenylFJsPbx737iOGTssbgSSeokpanna/UOGu9QGQ8tOFQRvsE9mSnv1vFzHcoJcdmiNPhW8IR7nsXg689gV41HLS34UtEKPKmZg4cA=="}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:59:50.056510 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:59:50.063263 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:59:50.064007 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:59:50.065045 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:59:50.065788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:59:50.066744 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:59:50.203701 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Getting quotas for project c160176d8c804b7793bae21c205c538c. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 12:59:50.224948 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Getting quotas for user 60860294eb284b8aa11edd42dca4ae8d and project c160176d8c804b7793bae21c205c538c. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 12:59:50.254558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-d4132fc2-9f58-4870-b0e0-e94eddf044d8 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for project 6c0d083e8cef4333b9514d2256991647. Resources: {'key_pairs'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 12:59:50.290877 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-d4132fc2-9f58-4870-b0e0-e94eddf044d8 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for user 0bcbf6513b6a4df3b044fadfb7888d54 and project 6c0d083e8cef4333b9514d2256991647. Resources: {'key_pairs'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 12:59:50.295685 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Going to run 1 instances... {{(pid=118868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 12:59:50.302203 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 12:59:50.429333 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-d4132fc2-9f58-4870-b0e0-e94eddf044d8 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.769736 Oct 14 12:59:50.440444 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 5/9] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Oct 14 12:59:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 12:59:50.596696 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2ac3f71c-8ec0-4768-923f-15ea581337b0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.026202 Oct 14 12:59:50.609388 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 5/10] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 12:59:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 4041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 12:59:50.614041 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-1d87d8d4-b995-4f47-a163-de151658fc93 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:59:50.614986 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-1d87d8d4-b995-4f47-a163-de151658fc93 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 12:59:50.943498 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-1d87d8d4-b995-4f47-a163-de151658fc93 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 12:59:50.995809 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-1d87d8d4-b995-4f47-a163-de151658fc93 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1221 microversion: 2.1 time: 0.379981 Oct 14 12:59:51.008023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 6/11] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 12:59:50 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1221 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 12:59:52.016852 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c0e2267e-7dc4-467e-bf05-d007860a8f5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Action: 'create', calling method: .version_select at 0x7fbb82871280>, body: {"keypair": {"name": "tempest-keypair-68197082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM8F9T46tY/rx8yvRMJAxt5YdtYlFMeXmNo0H77OP4a2nhvzPs/ZdMFJnKEnCe5gP/PLIUQ2ErkN2UiUnEhSx03k+rBy0Sxqd+cksMY1UdC5MwhltdLd/Fsoqn8qWO70w=="}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:59:52.050624 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-c0e2267e-7dc4-467e-bf05-d007860a8f5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Getting quotas for project 9247e549c63f4a42be20f5a7aeda0594. Resources: {'key_pairs'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 12:59:52.060788 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-c0e2267e-7dc4-467e-bf05-d007860a8f5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Getting quotas for user 9394667740f44bcab24ee484b195fe96 and project 9247e549c63f4a42be20f5a7aeda0594. Resources: {'key_pairs'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 12:59:52.124510 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1391243653", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "networks": [{"uuid": "a546b534-90d1-415c-b2ee-872aaf5897d8"}]}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:59:52.149662 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c0e2267e-7dc4-467e-bf05-d007860a8f5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.919801 Oct 14 12:59:52.155415 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 7/12] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Oct 14 12:59:51 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 12:59:52.171864 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-203353038", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 12:59:52.258718 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.network.neutron [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] validate_networks() for [('a546b534-90d1-415c-b2ee-872aaf5897d8', None, None, None, None, None)] {{(pid=118868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 12:59:52.378483 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.network.neutron [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] validate_networks() for [('71d7f67c-efcc-4a77-8c43-10bba17af0b2', None, None, None, None, None)] {{(pid=118869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 12:59:53.852494 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Flavor limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 12:59:53.853758 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Image limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 12:59:53.855624 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Flavor pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 12:59:53.856317 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Image pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 12:59:53.857105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 12:59:53.887972 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:59:53.892212 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:59:53.894510 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:59:53.896405 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:59:53.898699 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:59:53.900201 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:59:53.965909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Getting quotas for project 758ac8ee488d498882fce45dc7255676. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 12:59:53.972356 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Getting quotas for user 4a23786597854812a0931f8622ce38c7 and project 758ac8ee488d498882fce45dc7255676. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 12:59:53.997387 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Going to run 1 instances... {{(pid=118868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 12:59:53.999892 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 12:59:54.106716 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0236c425-8b40-4411-86d4-80a3dd685780 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.051526 Oct 14 12:59:54.114171 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 6/13] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 12:59:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 12:59:54.153974 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2f39c3f4-8fd0-4c8c-b921-4c8f620eba7c tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:59:54.155350 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2f39c3f4-8fd0-4c8c-b921-4c8f620eba7c tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 12:59:54.509716 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2f39c3f4-8fd0-4c8c-b921-4c8f620eba7c tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 12:59:54.540074 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2f39c3f4-8fd0-4c8c-b921-4c8f620eba7c tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1215 microversion: 2.1 time: 0.420372 Oct 14 12:59:54.556550 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 7/14] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 12:59:54 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1215 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 12:59:55.568738 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2273c556-52eb-408c-a69f-0f949845a077 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:59:55.569369 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2273c556-52eb-408c-a69f-0f949845a077 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 12:59:55.800874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2273c556-52eb-408c-a69f-0f949845a077 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 12:59:55.815179 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2273c556-52eb-408c-a69f-0f949845a077 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1215 microversion: 2.1 time: 0.251330 Oct 14 12:59:55.823164 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 8/15] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 12:59:55 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1215 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 12:59:56.867678 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-bf115c48-f478-4306-bc72-b874c2a346f2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:59:56.868285 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-bf115c48-f478-4306-bc72-b874c2a346f2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 12:59:56.884104 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bf115c48-f478-4306-bc72-b874c2a346f2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:59:56.885026 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bf115c48-f478-4306-bc72-b874c2a346f2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:59:56.885026 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bf115c48-f478-4306-bc72-b874c2a346f2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:59:56.885780 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bf115c48-f478-4306-bc72-b874c2a346f2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:59:56.886821 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bf115c48-f478-4306-bc72-b874c2a346f2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:59:56.887256 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bf115c48-f478-4306-bc72-b874c2a346f2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:59:57.372415 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-bf115c48-f478-4306-bc72-b874c2a346f2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 12:59:57.414716 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-bf115c48-f478-4306-bc72-b874c2a346f2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1267 microversion: 2.1 time: 0.541342 Oct 14 12:59:57.436172 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 9/16] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 12:59:56 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1267 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 12:59:58.451209 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f1eb565d-4d52-45f3-8669-66452e8c840f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:59:58.451875 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-f1eb565d-4d52-45f3-8669-66452e8c840f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 12:59:58.503232 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f1eb565d-4d52-45f3-8669-66452e8c840f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:59:58.504106 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f1eb565d-4d52-45f3-8669-66452e8c840f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:59:58.506006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f1eb565d-4d52-45f3-8669-66452e8c840f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:59:58.506980 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f1eb565d-4d52-45f3-8669-66452e8c840f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:59:58.513018 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f1eb565d-4d52-45f3-8669-66452e8c840f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:59:58.515045 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f1eb565d-4d52-45f3-8669-66452e8c840f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:59:58.710764 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f1eb565d-4d52-45f3-8669-66452e8c840f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 12:59:58.725134 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f1eb565d-4d52-45f3-8669-66452e8c840f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1273 microversion: 2.1 time: 0.279994 Oct 14 12:59:58.726697 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 10/17] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 12:59:58 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1273 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 12:59:59.095149 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Flavor limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 12:59:59.095612 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Image limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 12:59:59.096106 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Flavor pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 12:59:59.096513 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Image pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 12:59:59.097051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 12:59:59.142746 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:59:59.149150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:59:59.149685 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:59:59.158146 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:59:59.159351 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:59:59.165716 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:59:59.278781 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Getting quotas for project c160176d8c804b7793bae21c205c538c. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 12:59:59.286699 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Getting quotas for user 60860294eb284b8aa11edd42dca4ae8d and project c160176d8c804b7793bae21c205c538c. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 12:59:59.324056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Going to run 1 instances... {{(pid=118869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 12:59:59.338866 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 12:59:59.479861 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-93a674d9-0559-40e2-b363-8aa54d843a7b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.322913 Oct 14 12:59:59.490736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 8/18] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 12:59:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 7334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 12:59:59.494011 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-01cf8b0c-cad4-4b0e-9079-21326fcad800 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:59:59.494626 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-01cf8b0c-cad4-4b0e-9079-21326fcad800 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 12:59:59.757695 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-b54cb5fe-4934-4fd9-b2fc-a95808edeeb6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 12:59:59.758416 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-b54cb5fe-4934-4fd9-b2fc-a95808edeeb6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 12:59:59.767123 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b54cb5fe-4934-4fd9-b2fc-a95808edeeb6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:59:59.768368 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b54cb5fe-4934-4fd9-b2fc-a95808edeeb6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:59:59.768748 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b54cb5fe-4934-4fd9-b2fc-a95808edeeb6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:59:59.770020 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b54cb5fe-4934-4fd9-b2fc-a95808edeeb6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 12:59:59.772655 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b54cb5fe-4934-4fd9-b2fc-a95808edeeb6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 12:59:59.773279 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b54cb5fe-4934-4fd9-b2fc-a95808edeeb6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 12:59:59.960659 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-01cf8b0c-cad4-4b0e-9079-21326fcad800 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 12:59:59.973951 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-01cf8b0c-cad4-4b0e-9079-21326fcad800 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1221 microversion: 2.1 time: 0.483298 Oct 14 13:00:00.006523 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 11/19] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 12:59:59 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1221 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:00.252156 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-b54cb5fe-4934-4fd9-b2fc-a95808edeeb6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:00.274726 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-b54cb5fe-4934-4fd9-b2fc-a95808edeeb6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1273 microversion: 2.1 time: 0.522323 Oct 14 13:00:00.285838 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 9/20] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 12:59:59 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1273 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:01.008029 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b14d9b0a-8e5f-4f29-84f9-ed266c532485 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:01.008562 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b14d9b0a-8e5f-4f29-84f9-ed266c532485 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:01.040060 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b14d9b0a-8e5f-4f29-84f9-ed266c532485 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:01.042000 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b14d9b0a-8e5f-4f29-84f9-ed266c532485 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:01.043212 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b14d9b0a-8e5f-4f29-84f9-ed266c532485 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:01.044598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b14d9b0a-8e5f-4f29-84f9-ed266c532485 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:01.045061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b14d9b0a-8e5f-4f29-84f9-ed266c532485 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:01.046187 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b14d9b0a-8e5f-4f29-84f9-ed266c532485 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:01.283811 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b14d9b0a-8e5f-4f29-84f9-ed266c532485 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:01.305551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4efe1c72-8e37-4902-afba-8cbb7851fde2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:01.306175 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4efe1c72-8e37-4902-afba-8cbb7851fde2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:01.342477 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b14d9b0a-8e5f-4f29-84f9-ed266c532485 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1273 microversion: 2.1 time: 0.340686 Oct 14 13:00:01.349175 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4efe1c72-8e37-4902-afba-8cbb7851fde2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:01.349722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4efe1c72-8e37-4902-afba-8cbb7851fde2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:01.351206 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 12/21] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:00 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1273 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:01.372699 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4efe1c72-8e37-4902-afba-8cbb7851fde2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:01.376186 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4efe1c72-8e37-4902-afba-8cbb7851fde2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:01.377388 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4efe1c72-8e37-4902-afba-8cbb7851fde2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:01.380562 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4efe1c72-8e37-4902-afba-8cbb7851fde2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:02.217914 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4efe1c72-8e37-4902-afba-8cbb7851fde2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:02.241519 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4efe1c72-8e37-4902-afba-8cbb7851fde2 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1273 microversion: 2.1 time: 0.939555 Oct 14 13:00:02.247268 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 10/22] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:01 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1273 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:02.376972 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-18586add-3cab-40e7-ad81-f9e37e37e72a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:02.377620 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-18586add-3cab-40e7-ad81-f9e37e37e72a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:02.391070 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-18586add-3cab-40e7-ad81-f9e37e37e72a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:02.391575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-18586add-3cab-40e7-ad81-f9e37e37e72a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:02.392015 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-18586add-3cab-40e7-ad81-f9e37e37e72a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:02.392728 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-18586add-3cab-40e7-ad81-f9e37e37e72a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:02.397054 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-18586add-3cab-40e7-ad81-f9e37e37e72a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:02.397845 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-18586add-3cab-40e7-ad81-f9e37e37e72a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:02.662110 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-18586add-3cab-40e7-ad81-f9e37e37e72a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:02.674087 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-18586add-3cab-40e7-ad81-f9e37e37e72a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1279 microversion: 2.1 time: 0.301006 Oct 14 13:00:02.681188 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 13/23] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:02 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1279 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:03.270196 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a68b9b33-9020-4487-b1ad-01e6df3c75b7 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:03.271019 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-a68b9b33-9020-4487-b1ad-01e6df3c75b7 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:03.284674 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a68b9b33-9020-4487-b1ad-01e6df3c75b7 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:03.285775 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a68b9b33-9020-4487-b1ad-01e6df3c75b7 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:03.288595 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a68b9b33-9020-4487-b1ad-01e6df3c75b7 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:03.294877 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a68b9b33-9020-4487-b1ad-01e6df3c75b7 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:03.296015 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a68b9b33-9020-4487-b1ad-01e6df3c75b7 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:03.297955 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a68b9b33-9020-4487-b1ad-01e6df3c75b7 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:03.722955 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-3bed12bb-fa9a-4adc-92b3-4a9e75fa2113 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:03.723576 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-3bed12bb-fa9a-4adc-92b3-4a9e75fa2113 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:03.744492 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3bed12bb-fa9a-4adc-92b3-4a9e75fa2113 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:03.744999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3bed12bb-fa9a-4adc-92b3-4a9e75fa2113 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:03.746031 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3bed12bb-fa9a-4adc-92b3-4a9e75fa2113 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:03.746737 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3bed12bb-fa9a-4adc-92b3-4a9e75fa2113 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:03.762276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3bed12bb-fa9a-4adc-92b3-4a9e75fa2113 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:03.762733 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3bed12bb-fa9a-4adc-92b3-4a9e75fa2113 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:03.815954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a68b9b33-9020-4487-b1ad-01e6df3c75b7 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:03.834238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-a68b9b33-9020-4487-b1ad-01e6df3c75b7 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1273 microversion: 2.1 time: 0.563572 Oct 14 13:00:03.834929 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 11/24] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:03 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1273 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:03.940519 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=4 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:04.247796 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3bed12bb-fa9a-4adc-92b3-4a9e75fa2113 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:04.273713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-3bed12bb-fa9a-4adc-92b3-4a9e75fa2113 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1279 microversion: 2.1 time: 0.562212 Oct 14 13:00:04.296586 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 14/25] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:03 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1279 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:04.858928 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4a6aa68b-f50a-4efd-aab2-d3fdf793e7ab tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:04.860741 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-4a6aa68b-f50a-4efd-aab2-d3fdf793e7ab tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:04.873766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4a6aa68b-f50a-4efd-aab2-d3fdf793e7ab tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:04.877985 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4a6aa68b-f50a-4efd-aab2-d3fdf793e7ab tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:04.880257 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4a6aa68b-f50a-4efd-aab2-d3fdf793e7ab tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:04.891430 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4a6aa68b-f50a-4efd-aab2-d3fdf793e7ab tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:04.892337 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4a6aa68b-f50a-4efd-aab2-d3fdf793e7ab tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:04.893814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4a6aa68b-f50a-4efd-aab2-d3fdf793e7ab tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:04.929647 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-87e1bdd8-00ee-44a5-9e8f-15d1a5522c42 req-6ec343ba-ed20-4f58-b62c-779888506f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20015651-8ebe-44d9-9d4a-b4e15741c295", "tag": "4749694d-66d5-4de8-b827-176ffeb49aa3"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:04.957725 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-87e1bdd8-00ee-44a5-9e8f-15d1a5522c42 req-6ec343ba-ed20-4f58-b62c-779888506f07 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:04.958472 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-87e1bdd8-00ee-44a5-9e8f-15d1a5522c42 req-6ec343ba-ed20-4f58-b62c-779888506f07 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:04.959055 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-87e1bdd8-00ee-44a5-9e8f-15d1a5522c42 req-6ec343ba-ed20-4f58-b62c-779888506f07 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:05.030602 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-87e1bdd8-00ee-44a5-9e8f-15d1a5522c42 req-6ec343ba-ed20-4f58-b62c-779888506f07 service nova] Creating event network-changed:4749694d-66d5-4de8-b827-176ffeb49aa3 for instance 20015651-8ebe-44d9-9d4a-b4e15741c295 on hv-cinder-82099 Oct 14 13:00:05.031157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-87e1bdd8-00ee-44a5-9e8f-15d1a5522c42 req-6ec343ba-ed20-4f58-b62c-779888506f07 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 14 13:00:05.031562 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-87e1bdd8-00ee-44a5-9e8f-15d1a5522c42 req-6ec343ba-ed20-4f58-b62c-779888506f07 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 14 13:00:05.041119 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20535d0d-87e3-48dc-ba84-eead0cf919c5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:05.041926 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20535d0d-87e3-48dc-ba84-eead0cf919c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:05.042953 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20535d0d-87e3-48dc-ba84-eead0cf919c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:05.043756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20535d0d-87e3-48dc-ba84-eead0cf919c5 None None] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:05.044217 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20535d0d-87e3-48dc-ba84-eead0cf919c5 None None] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:05.044651 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20535d0d-87e3-48dc-ba84-eead0cf919c5 None None] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:05.090038 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.compute.rpcapi [None req-20535d0d-87e3-48dc-ba84-eead0cf919c5 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 14 13:00:05.091901 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20535d0d-87e3-48dc-ba84-eead0cf919c5 None None] Releasing lock "compute-rpcapi-router" {{(pid=118869) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 14 13:00:05.163816 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-20535d0d-87e3-48dc-ba84-eead0cf919c5 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.923446 Oct 14 13:00:05.167737 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 12/26] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:00:05.191912 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-650108237", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "70bca7d9-a052-4048-8e74-16b14b95c03e"}], "security_groups": [{"name": "tempest-securitygroup--530379640"}], "key_name": "tempest-keypair-246404629", "user_data": "}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:05.639005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-4a6aa68b-f50a-4efd-aab2-d3fdf793e7ab tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:05.664087 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4a6aa68b-f50a-4efd-aab2-d3fdf793e7ab tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1315 microversion: 2.1 time: 0.811085 Oct 14 13:00:05.679652 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 15/27] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:04 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1315 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:05.682355 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-685570ba-ffc3-4cc5-92b6-47f5909e2c24 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:05.689866 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-685570ba-ffc3-4cc5-92b6-47f5909e2c24 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:05.717979 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-685570ba-ffc3-4cc5-92b6-47f5909e2c24 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:05.718688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-685570ba-ffc3-4cc5-92b6-47f5909e2c24 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:05.719194 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-685570ba-ffc3-4cc5-92b6-47f5909e2c24 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:05.720094 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-685570ba-ffc3-4cc5-92b6-47f5909e2c24 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:05.720651 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-685570ba-ffc3-4cc5-92b6-47f5909e2c24 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:05.721081 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-685570ba-ffc3-4cc5-92b6-47f5909e2c24 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:06.235093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.network.neutron [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] validate_networks() for [('70bca7d9-a052-4048-8e74-16b14b95c03e', None, None, None, None, None)] {{(pid=118869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:00:06.337947 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-685570ba-ffc3-4cc5-92b6-47f5909e2c24 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:06.349456 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-685570ba-ffc3-4cc5-92b6-47f5909e2c24 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1279 microversion: 2.1 time: 0.683037 Oct 14 13:00:06.353583 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 16/28] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:05 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1279 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:06.688677 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e739028f-4e17-41cd-802b-730da00ea8e0 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:06.691060 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e739028f-4e17-41cd-802b-730da00ea8e0 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:06.699738 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e739028f-4e17-41cd-802b-730da00ea8e0 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:06.702878 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e739028f-4e17-41cd-802b-730da00ea8e0 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:06.709654 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e739028f-4e17-41cd-802b-730da00ea8e0 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:06.710679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e739028f-4e17-41cd-802b-730da00ea8e0 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:06.713937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e739028f-4e17-41cd-802b-730da00ea8e0 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:06.714514 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e739028f-4e17-41cd-802b-730da00ea8e0 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:07.241566 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e739028f-4e17-41cd-802b-730da00ea8e0 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:07.257580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e739028f-4e17-41cd-802b-730da00ea8e0 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1315 microversion: 2.1 time: 0.572688 Oct 14 13:00:07.262538 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 17/29] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:06 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:07.381160 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-bc83ff25-9116-4fab-98c8-040dff36f8a7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:07.382713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-bc83ff25-9116-4fab-98c8-040dff36f8a7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:07.399113 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bc83ff25-9116-4fab-98c8-040dff36f8a7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:07.403132 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bc83ff25-9116-4fab-98c8-040dff36f8a7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:07.405629 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bc83ff25-9116-4fab-98c8-040dff36f8a7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:07.408201 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bc83ff25-9116-4fab-98c8-040dff36f8a7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:07.412902 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bc83ff25-9116-4fab-98c8-040dff36f8a7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:07.413653 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bc83ff25-9116-4fab-98c8-040dff36f8a7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:08.604081 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-bc83ff25-9116-4fab-98c8-040dff36f8a7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:08.614152 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-bc83ff25-9116-4fab-98c8-040dff36f8a7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1321 microversion: 2.1 time: 1.237612 Oct 14 13:00:08.620437 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 18/30] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:07 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1321 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:08.641958 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-19131f4d-4564-4d02-85e4-a739a9e97500 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:08.644704 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-19131f4d-4564-4d02-85e4-a739a9e97500 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:08.668938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19131f4d-4564-4d02-85e4-a739a9e97500 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:08.669766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19131f4d-4564-4d02-85e4-a739a9e97500 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:08.670373 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19131f4d-4564-4d02-85e4-a739a9e97500 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:08.671238 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19131f4d-4564-4d02-85e4-a739a9e97500 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:08.671850 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19131f4d-4564-4d02-85e4-a739a9e97500 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:08.672436 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19131f4d-4564-4d02-85e4-a739a9e97500 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:08.982044 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-19131f4d-4564-4d02-85e4-a739a9e97500 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:09.001993 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-19131f4d-4564-4d02-85e4-a739a9e97500 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1315 microversion: 2.1 time: 0.375922 Oct 14 13:00:09.004244 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 19/31] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:08 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:09.024715 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1134718719", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "19221892-26e2-485e-83b6-c9b12590cb03"}], "security_groups": [{"name": "tempest-securitygroup--656458205"}], "key_name": "tempest-keypair-68197082", "user_data": "}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:09.295189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.network.neutron [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] validate_networks() for [('19221892-26e2-485e-83b6-c9b12590cb03', None, None, None, None, None)] {{(pid=118868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:00:09.302341 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=16 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:09.837206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Flavor limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:00:09.837507 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Image limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:00:09.840077 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Flavor pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:00:09.841354 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Image pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:00:09.842412 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:00:09.862869 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:09.863433 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:09.863878 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:09.864682 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:09.866536 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:09.867209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:09.896450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for project 6c0d083e8cef4333b9514d2256991647. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:00:09.902575 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for user 0bcbf6513b6a4df3b044fadfb7888d54 and project 6c0d083e8cef4333b9514d2256991647. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:00:09.943139 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Going to run 1 instances... {{(pid=118869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:00:09.946473 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:00:09.969345 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=18 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:10.047926 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-262be705-f414-4018-a31e-86bb689ceee6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.877408 Oct 14 13:00:10.051222 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 13/32] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:00:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 4883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 13:00:10.064972 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-269f14a9-5199-4db4-befc-95b107109a0a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:10.064972 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-269f14a9-5199-4db4-befc-95b107109a0a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:10.099249 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-269f14a9-5199-4db4-befc-95b107109a0a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:10.099790 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-269f14a9-5199-4db4-befc-95b107109a0a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:10.106827 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-269f14a9-5199-4db4-befc-95b107109a0a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:10.131622 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-269f14a9-5199-4db4-befc-95b107109a0a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:10.132212 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-269f14a9-5199-4db4-befc-95b107109a0a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:10.132665 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-269f14a9-5199-4db4-befc-95b107109a0a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:10.411198 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Flavor limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:00:10.411713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Image limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:00:10.412329 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Flavor pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:00:10.413804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Image pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:00:10.414505 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:00:10.430067 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:10.430844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:10.431553 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:10.433807 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:10.435261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:10.436399 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:10.470247 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Getting quotas for project 9247e549c63f4a42be20f5a7aeda0594. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:00:10.475610 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Getting quotas for user 9394667740f44bcab24ee484b195fe96 and project 9247e549c63f4a42be20f5a7aeda0594. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:00:10.494614 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Going to run 1 instances... {{(pid=118868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:00:10.498064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:00:10.670383 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-33d77f64-d131-41f1-a2ee-7a41f8f58bb9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.660971 Oct 14 13:00:10.680634 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 20/33] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:00:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 1675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 13:00:10.703005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c5762453-8425-4d67-bb32-d71385283cfc tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:10.705322 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c5762453-8425-4d67-bb32-d71385283cfc tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:10.721475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c5762453-8425-4d67-bb32-d71385283cfc tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:10.722894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c5762453-8425-4d67-bb32-d71385283cfc tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:10.725724 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c5762453-8425-4d67-bb32-d71385283cfc tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:10.728432 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c5762453-8425-4d67-bb32-d71385283cfc tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:10.729076 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c5762453-8425-4d67-bb32-d71385283cfc tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:10.729707 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c5762453-8425-4d67-bb32-d71385283cfc tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:10.795502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-269f14a9-5199-4db4-befc-95b107109a0a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:10.803095 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-269f14a9-5199-4db4-befc-95b107109a0a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1321 microversion: 2.1 time: 0.750346 Oct 14 13:00:10.803655 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 14/34] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:10 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1321 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:10.819418 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5845b75d-d46b-4cda-bff5-2dff5e7712b3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:10.819418 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5845b75d-d46b-4cda-bff5-2dff5e7712b3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:11.080917 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c5762453-8425-4d67-bb32-d71385283cfc tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:11.093738 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c5762453-8425-4d67-bb32-d71385283cfc tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1315 microversion: 2.1 time: 0.410259 Oct 14 13:00:11.096728 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 21/35] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:10 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:11.107664 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5a8b8ba4-1643-4c88-9c8a-44e74b3483a5 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:11.110974 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5a8b8ba4-1643-4c88-9c8a-44e74b3483a5 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:11.203332 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5a8b8ba4-1643-4c88-9c8a-44e74b3483a5 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:11.228712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5a8b8ba4-1643-4c88-9c8a-44e74b3483a5 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1236 microversion: 2.1 time: 0.128785 Oct 14 13:00:11.232077 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 22/36] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:11 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1236 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:11.406712 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-5845b75d-d46b-4cda-bff5-2dff5e7712b3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:11.413908 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5845b75d-d46b-4cda-bff5-2dff5e7712b3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1240 microversion: 2.1 time: 0.607246 Oct 14 13:00:11.414481 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 15/37] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:10 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1240 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:11.830566 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-a1de1222-6aff-4baf-ac99-cd5346cf6a4a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:11.831570 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-a1de1222-6aff-4baf-ac99-cd5346cf6a4a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:11.845310 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a1de1222-6aff-4baf-ac99-cd5346cf6a4a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:11.847540 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a1de1222-6aff-4baf-ac99-cd5346cf6a4a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:11.851025 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a1de1222-6aff-4baf-ac99-cd5346cf6a4a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:11.852878 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a1de1222-6aff-4baf-ac99-cd5346cf6a4a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:11.855301 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a1de1222-6aff-4baf-ac99-cd5346cf6a4a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:11.860646 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a1de1222-6aff-4baf-ac99-cd5346cf6a4a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:12.118280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-982d5227-7554-40ac-9061-17a2c97d8bfe tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:12.119756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-982d5227-7554-40ac-9061-17a2c97d8bfe tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:12.128345 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-982d5227-7554-40ac-9061-17a2c97d8bfe tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:12.132154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-982d5227-7554-40ac-9061-17a2c97d8bfe tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:12.134099 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-982d5227-7554-40ac-9061-17a2c97d8bfe tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:12.138982 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-982d5227-7554-40ac-9061-17a2c97d8bfe tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:12.141223 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-982d5227-7554-40ac-9061-17a2c97d8bfe tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:12.146734 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-982d5227-7554-40ac-9061-17a2c97d8bfe tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:12.245002 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-a1de1222-6aff-4baf-ac99-cd5346cf6a4a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:12.258634 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-a1de1222-6aff-4baf-ac99-cd5346cf6a4a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1321 microversion: 2.1 time: 0.434060 Oct 14 13:00:12.268664 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 23/38] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:11 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:12.291619 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-8223169f-a59b-446b-8248-9651b2d91ce6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:12.292579 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-8223169f-a59b-446b-8248-9651b2d91ce6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:12.303192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8223169f-a59b-446b-8248-9651b2d91ce6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:12.304164 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8223169f-a59b-446b-8248-9651b2d91ce6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:12.305505 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8223169f-a59b-446b-8248-9651b2d91ce6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:12.306543 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8223169f-a59b-446b-8248-9651b2d91ce6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:12.308036 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8223169f-a59b-446b-8248-9651b2d91ce6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:12.308644 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8223169f-a59b-446b-8248-9651b2d91ce6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:12.391508 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-8223169f-a59b-446b-8248-9651b2d91ce6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:12.416205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-8223169f-a59b-446b-8248-9651b2d91ce6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1232 microversion: 2.1 time: 0.150774 Oct 14 13:00:12.442094 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 24/39] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:12 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1232 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:12.525951 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-982d5227-7554-40ac-9061-17a2c97d8bfe tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:12.539761 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-982d5227-7554-40ac-9061-17a2c97d8bfe tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1315 microversion: 2.1 time: 0.425446 Oct 14 13:00:12.558524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 16/40] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:12 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:12.575746 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2aebef95-adbd-43c6-8d4c-c079e1ceb8a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:12.585025 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-2aebef95-adbd-43c6-8d4c-c079e1ceb8a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:12.597421 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2aebef95-adbd-43c6-8d4c-c079e1ceb8a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:12.603462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2aebef95-adbd-43c6-8d4c-c079e1ceb8a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:12.604192 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2aebef95-adbd-43c6-8d4c-c079e1ceb8a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:12.608300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2aebef95-adbd-43c6-8d4c-c079e1ceb8a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:12.609270 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2aebef95-adbd-43c6-8d4c-c079e1ceb8a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:12.609959 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2aebef95-adbd-43c6-8d4c-c079e1ceb8a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:12.708802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-1b8294dc-4fd7-4923-8539-b0de3f8b24b3 req-d4e2981b-0a10-41cb-9e95-69a2944eb369 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b", "tag": "5db67f63-ad2c-4649-84c2-af882da8c339"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:12.747882 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-1b8294dc-4fd7-4923-8539-b0de3f8b24b3 req-d4e2981b-0a10-41cb-9e95-69a2944eb369 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:12.749412 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-1b8294dc-4fd7-4923-8539-b0de3f8b24b3 req-d4e2981b-0a10-41cb-9e95-69a2944eb369 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:12.750193 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-1b8294dc-4fd7-4923-8539-b0de3f8b24b3 req-d4e2981b-0a10-41cb-9e95-69a2944eb369 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:12.786540 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-2aebef95-adbd-43c6-8d4c-c079e1ceb8a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:12.801853 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-2aebef95-adbd-43c6-8d4c-c079e1ceb8a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1292 microversion: 2.1 time: 0.230352 Oct 14 13:00:12.805329 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 17/41] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:12 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1292 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:12.808561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-1b8294dc-4fd7-4923-8539-b0de3f8b24b3 req-d4e2981b-0a10-41cb-9e95-69a2944eb369 service nova] Creating event network-changed:5db67f63-ad2c-4649-84c2-af882da8c339 for instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b on hv-cinder-82099 Oct 14 13:00:12.819552 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-1b8294dc-4fd7-4923-8539-b0de3f8b24b3 req-d4e2981b-0a10-41cb-9e95-69a2944eb369 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 14 13:00:12.820503 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-1b8294dc-4fd7-4923-8539-b0de3f8b24b3 req-d4e2981b-0a10-41cb-9e95-69a2944eb369 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 14 13:00:12.824689 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aa975371-2dba-4393-9941-69c1a77ac7e2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:12.830866 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aa975371-2dba-4393-9941-69c1a77ac7e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:12.832260 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aa975371-2dba-4393-9941-69c1a77ac7e2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:12.833378 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aa975371-2dba-4393-9941-69c1a77ac7e2 None None] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:12.843385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aa975371-2dba-4393-9941-69c1a77ac7e2 None None] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:12.844486 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aa975371-2dba-4393-9941-69c1a77ac7e2 None None] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:12.896779 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.compute.rpcapi [None req-aa975371-2dba-4393-9941-69c1a77ac7e2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 14 13:00:12.908850 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aa975371-2dba-4393-9941-69c1a77ac7e2 None None] Releasing lock "compute-rpcapi-router" {{(pid=118868) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 14 13:00:12.954402 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-aa975371-2dba-4393-9941-69c1a77ac7e2 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.502694 Oct 14 13:00:12.954402 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 25/42] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:00:13.289771 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cf14e0f0-1f26-4fb7-bc2d-bd77d8eecba8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:13.289771 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-cf14e0f0-1f26-4fb7-bc2d-bd77d8eecba8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:13.299412 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf14e0f0-1f26-4fb7-bc2d-bd77d8eecba8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:13.302561 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf14e0f0-1f26-4fb7-bc2d-bd77d8eecba8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:13.303026 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf14e0f0-1f26-4fb7-bc2d-bd77d8eecba8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:13.303741 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf14e0f0-1f26-4fb7-bc2d-bd77d8eecba8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:13.304971 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf14e0f0-1f26-4fb7-bc2d-bd77d8eecba8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:13.305410 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf14e0f0-1f26-4fb7-bc2d-bd77d8eecba8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:13.444318 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-36e2b503-46ef-4ca5-b133-2012a0ef8693 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:13.445081 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-36e2b503-46ef-4ca5-b133-2012a0ef8693 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:13.454994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36e2b503-46ef-4ca5-b133-2012a0ef8693 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:13.455490 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36e2b503-46ef-4ca5-b133-2012a0ef8693 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:13.457335 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36e2b503-46ef-4ca5-b133-2012a0ef8693 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:13.460071 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36e2b503-46ef-4ca5-b133-2012a0ef8693 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:13.460745 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36e2b503-46ef-4ca5-b133-2012a0ef8693 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:13.465395 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36e2b503-46ef-4ca5-b133-2012a0ef8693 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:13.509067 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-cf14e0f0-1f26-4fb7-bc2d-bd77d8eecba8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:13.517823 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-cf14e0f0-1f26-4fb7-bc2d-bd77d8eecba8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1321 microversion: 2.1 time: 0.237219 Oct 14 13:00:13.520220 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 18/43] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:13 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:13.564452 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-6d5a7845-4f46-427e-9c1a-4a14a3796d24 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:13.565186 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-6d5a7845-4f46-427e-9c1a-4a14a3796d24 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:13.568183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-36e2b503-46ef-4ca5-b133-2012a0ef8693 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:13.572497 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d5a7845-4f46-427e-9c1a-4a14a3796d24 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:13.573017 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d5a7845-4f46-427e-9c1a-4a14a3796d24 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:13.573456 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d5a7845-4f46-427e-9c1a-4a14a3796d24 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:13.575339 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d5a7845-4f46-427e-9c1a-4a14a3796d24 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:13.575802 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d5a7845-4f46-427e-9c1a-4a14a3796d24 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:13.576141 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-36e2b503-46ef-4ca5-b133-2012a0ef8693 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1288 microversion: 2.1 time: 0.136909 Oct 14 13:00:13.576258 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d5a7845-4f46-427e-9c1a-4a14a3796d24 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:13.576724 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 26/44] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:13 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1288 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:13.774887 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-6d5a7845-4f46-427e-9c1a-4a14a3796d24 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:13.789844 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-6d5a7845-4f46-427e-9c1a-4a14a3796d24 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1315 microversion: 2.1 time: 0.225875 Oct 14 13:00:13.794314 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 19/45] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:13 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:13.825994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-37a37d66-29aa-48ec-9031-d86e504105cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:13.826762 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-37a37d66-29aa-48ec-9031-d86e504105cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:13.844313 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-37a37d66-29aa-48ec-9031-d86e504105cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:13.845041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-37a37d66-29aa-48ec-9031-d86e504105cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:13.846976 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-37a37d66-29aa-48ec-9031-d86e504105cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:13.849578 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-37a37d66-29aa-48ec-9031-d86e504105cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:13.851453 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-37a37d66-29aa-48ec-9031-d86e504105cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:13.853512 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-37a37d66-29aa-48ec-9031-d86e504105cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:14.282757 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-37a37d66-29aa-48ec-9031-d86e504105cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:14.286605 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=100 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:14.294699 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-37a37d66-29aa-48ec-9031-d86e504105cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1365 microversion: 2.1 time: 0.473944 Oct 14 13:00:14.295563 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 27/46] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:13 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1365 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:14.541609 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-b538f214-f6ec-4982-90b3-f6ba261c46d6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:14.542951 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-b538f214-f6ec-4982-90b3-f6ba261c46d6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:14.550116 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b538f214-f6ec-4982-90b3-f6ba261c46d6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:14.550617 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b538f214-f6ec-4982-90b3-f6ba261c46d6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:14.551583 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b538f214-f6ec-4982-90b3-f6ba261c46d6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:14.552476 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b538f214-f6ec-4982-90b3-f6ba261c46d6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:14.553083 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b538f214-f6ec-4982-90b3-f6ba261c46d6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:14.553702 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b538f214-f6ec-4982-90b3-f6ba261c46d6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:14.605522 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-8134c48e-5a72-4dae-aab7-0ea34ef5fa66 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:14.607744 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-8134c48e-5a72-4dae-aab7-0ea34ef5fa66 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:14.614416 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:14.628796 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8134c48e-5a72-4dae-aab7-0ea34ef5fa66 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:14.628796 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8134c48e-5a72-4dae-aab7-0ea34ef5fa66 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:14.628796 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8134c48e-5a72-4dae-aab7-0ea34ef5fa66 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:14.631336 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8134c48e-5a72-4dae-aab7-0ea34ef5fa66 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:14.631812 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8134c48e-5a72-4dae-aab7-0ea34ef5fa66 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:14.632244 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8134c48e-5a72-4dae-aab7-0ea34ef5fa66 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:14.727314 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-8134c48e-5a72-4dae-aab7-0ea34ef5fa66 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:14.737872 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-8134c48e-5a72-4dae-aab7-0ea34ef5fa66 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1288 microversion: 2.1 time: 0.136869 Oct 14 13:00:14.738891 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 28/47] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:14 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1288 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:14.817284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-26911bb6-8c63-470f-aea6-eeeb40aa7d98 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:14.818424 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-26911bb6-8c63-470f-aea6-eeeb40aa7d98 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:14.828727 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-26911bb6-8c63-470f-aea6-eeeb40aa7d98 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:14.830016 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-26911bb6-8c63-470f-aea6-eeeb40aa7d98 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:14.830690 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-26911bb6-8c63-470f-aea6-eeeb40aa7d98 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:14.831736 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-26911bb6-8c63-470f-aea6-eeeb40aa7d98 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:14.832284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-26911bb6-8c63-470f-aea6-eeeb40aa7d98 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:14.832999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-26911bb6-8c63-470f-aea6-eeeb40aa7d98 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:15.105285 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-26911bb6-8c63-470f-aea6-eeeb40aa7d98 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:15.114815 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-26911bb6-8c63-470f-aea6-eeeb40aa7d98 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1315 microversion: 2.1 time: 0.301704 Oct 14 13:00:15.131470 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 29/48] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:14 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:15.138218 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-a209c804-8d6b-40e4-84c2-4077a9085b07 req-0c84f7d1-18ae-4911-9c5f-3cd9659a3a3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad463f3e-be3e-40a0-ad61-6eab6a24f957", "tag": "9a1f9cf5-f6ac-458f-991e-d6fcead5660f"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:15.150050 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-a209c804-8d6b-40e4-84c2-4077a9085b07 req-0c84f7d1-18ae-4911-9c5f-3cd9659a3a3a service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:15.150590 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-a209c804-8d6b-40e4-84c2-4077a9085b07 req-0c84f7d1-18ae-4911-9c5f-3cd9659a3a3a service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:15.151785 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-a209c804-8d6b-40e4-84c2-4077a9085b07 req-0c84f7d1-18ae-4911-9c5f-3cd9659a3a3a service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:15.165267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-a209c804-8d6b-40e4-84c2-4077a9085b07 req-0c84f7d1-18ae-4911-9c5f-3cd9659a3a3a service nova] Creating event network-changed:9a1f9cf5-f6ac-458f-991e-d6fcead5660f for instance ad463f3e-be3e-40a0-ad61-6eab6a24f957 on hv-cinder-82099 Oct 14 13:00:15.171708 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-a209c804-8d6b-40e4-84c2-4077a9085b07 req-0c84f7d1-18ae-4911-9c5f-3cd9659a3a3a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038733 Oct 14 13:00:15.172077 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-b538f214-f6ec-4982-90b3-f6ba261c46d6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:15.173452 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 30/49] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:00:15.180657 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-b538f214-f6ec-4982-90b3-f6ba261c46d6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1321 microversion: 2.1 time: 0.644150 Oct 14 13:00:15.185698 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 20/50] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:14 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1321 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:15.326307 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-34e8fcfd-00a5-401a-9ba3-fa3a047bf1c3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:15.327196 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-34e8fcfd-00a5-401a-9ba3-fa3a047bf1c3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:15.345886 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-34e8fcfd-00a5-401a-9ba3-fa3a047bf1c3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:15.349964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-34e8fcfd-00a5-401a-9ba3-fa3a047bf1c3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:15.350420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-34e8fcfd-00a5-401a-9ba3-fa3a047bf1c3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:15.351277 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-34e8fcfd-00a5-401a-9ba3-fa3a047bf1c3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:15.351740 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-34e8fcfd-00a5-401a-9ba3-fa3a047bf1c3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:15.352159 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-34e8fcfd-00a5-401a-9ba3-fa3a047bf1c3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:15.762134 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ad85ea1d-8aba-4544-b949-47aeaff6d8f0 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:15.762843 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ad85ea1d-8aba-4544-b949-47aeaff6d8f0 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:15.778970 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ad85ea1d-8aba-4544-b949-47aeaff6d8f0 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:15.779668 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ad85ea1d-8aba-4544-b949-47aeaff6d8f0 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:15.781638 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ad85ea1d-8aba-4544-b949-47aeaff6d8f0 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:15.784590 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ad85ea1d-8aba-4544-b949-47aeaff6d8f0 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:15.785077 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ad85ea1d-8aba-4544-b949-47aeaff6d8f0 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:15.785529 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ad85ea1d-8aba-4544-b949-47aeaff6d8f0 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:15.900994 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ad85ea1d-8aba-4544-b949-47aeaff6d8f0 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:15.909425 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ad85ea1d-8aba-4544-b949-47aeaff6d8f0 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1294 microversion: 2.1 time: 0.152192 Oct 14 13:00:15.910721 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 21/51] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:15 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1294 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:15.991729 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-34e8fcfd-00a5-401a-9ba3-fa3a047bf1c3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:16.020629 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-34e8fcfd-00a5-401a-9ba3-fa3a047bf1c3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1365 microversion: 2.1 time: 0.688744 Oct 14 13:00:16.021279 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 31/52] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:15 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1365 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:16.141380 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-79bfa677-075c-4020-9aa7-d30181cf1509 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:16.143370 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-79bfa677-075c-4020-9aa7-d30181cf1509 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:16.155146 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-79bfa677-075c-4020-9aa7-d30181cf1509 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:16.156927 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-79bfa677-075c-4020-9aa7-d30181cf1509 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:16.160971 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-79bfa677-075c-4020-9aa7-d30181cf1509 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:16.162921 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-79bfa677-075c-4020-9aa7-d30181cf1509 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:16.163530 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-79bfa677-075c-4020-9aa7-d30181cf1509 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:16.164360 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-79bfa677-075c-4020-9aa7-d30181cf1509 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:16.209146 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-97887ea2-93b6-482b-b812-b045d4cbf01f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:16.210289 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-97887ea2-93b6-482b-b812-b045d4cbf01f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:16.232856 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-97887ea2-93b6-482b-b812-b045d4cbf01f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:16.235293 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-97887ea2-93b6-482b-b812-b045d4cbf01f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:16.239388 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-97887ea2-93b6-482b-b812-b045d4cbf01f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:16.242268 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-97887ea2-93b6-482b-b812-b045d4cbf01f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:16.244318 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-97887ea2-93b6-482b-b812-b045d4cbf01f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:16.246488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-97887ea2-93b6-482b-b812-b045d4cbf01f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:16.527661 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-79bfa677-075c-4020-9aa7-d30181cf1509 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:16.547413 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-79bfa677-075c-4020-9aa7-d30181cf1509 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1315 microversion: 2.1 time: 0.410989 Oct 14 13:00:16.548367 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 22/53] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:16 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:16.769358 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-97887ea2-93b6-482b-b812-b045d4cbf01f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:16.783949 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-97887ea2-93b6-482b-b812-b045d4cbf01f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1321 microversion: 2.1 time: 0.579848 Oct 14 13:00:16.784648 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 32/54] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:16 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1321 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:16.944986 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5a4a3108-1e34-40e3-a687-51986c576f95 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:16.946842 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-2a2b038c-e451-4419-87e7-e2c65a892828 req-1aa3fd9f-e1d0-4942-b870-3dbfb7d2d3af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defcc0c0-d0f4-4913-899d-4d20b75896d6", "tag": "1f5e8c9c-50a5-47d9-a8b7-c42df0f5a568"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:16.948745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5a4a3108-1e34-40e3-a687-51986c576f95 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:16.971141 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5a4a3108-1e34-40e3-a687-51986c576f95 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:16.971633 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5a4a3108-1e34-40e3-a687-51986c576f95 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:16.985809 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5a4a3108-1e34-40e3-a687-51986c576f95 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:16.986923 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5a4a3108-1e34-40e3-a687-51986c576f95 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:16.987408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5a4a3108-1e34-40e3-a687-51986c576f95 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:16.987843 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5a4a3108-1e34-40e3-a687-51986c576f95 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:17.011378 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-2a2b038c-e451-4419-87e7-e2c65a892828 req-1aa3fd9f-e1d0-4942-b870-3dbfb7d2d3af service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:17.012802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-2a2b038c-e451-4419-87e7-e2c65a892828 req-1aa3fd9f-e1d0-4942-b870-3dbfb7d2d3af service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:17.013250 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-2a2b038c-e451-4419-87e7-e2c65a892828 req-1aa3fd9f-e1d0-4942-b870-3dbfb7d2d3af service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:17.112688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-2a2b038c-e451-4419-87e7-e2c65a892828 req-1aa3fd9f-e1d0-4942-b870-3dbfb7d2d3af service nova] Creating event network-changed:1f5e8c9c-50a5-47d9-a8b7-c42df0f5a568 for instance defcc0c0-d0f4-4913-899d-4d20b75896d6 on hv-cinder-82099 Oct 14 13:00:17.129226 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-2a2b038c-e451-4419-87e7-e2c65a892828 req-1aa3fd9f-e1d0-4942-b870-3dbfb7d2d3af service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189508 Oct 14 13:00:17.134675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 33/55] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:00:17.148779 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-26f16025-98e9-4831-a107-445bd2255b50 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:17.150041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-26f16025-98e9-4831-a107-445bd2255b50 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:17.170759 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-26f16025-98e9-4831-a107-445bd2255b50 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:17.171481 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-26f16025-98e9-4831-a107-445bd2255b50 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:17.172148 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-26f16025-98e9-4831-a107-445bd2255b50 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:17.174615 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-26f16025-98e9-4831-a107-445bd2255b50 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:17.177088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-26f16025-98e9-4831-a107-445bd2255b50 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:17.178487 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-26f16025-98e9-4831-a107-445bd2255b50 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:17.608510 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-5a4a3108-1e34-40e3-a687-51986c576f95 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:17.623009 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5a4a3108-1e34-40e3-a687-51986c576f95 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1361 microversion: 2.1 time: 0.688101 Oct 14 13:00:17.624481 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 23/56] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:16 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1361 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:17.700128 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-26f16025-98e9-4831-a107-445bd2255b50 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:17.708857 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-26f16025-98e9-4831-a107-445bd2255b50 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1365 microversion: 2.1 time: 0.572870 Oct 14 13:00:17.709502 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 34/57] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:17 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1365 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:17.718577 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f0486e55-caf6-4345-a686-2747ef4b5c81 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:17.739356 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-f0486e55-caf6-4345-a686-2747ef4b5c81 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:17.761546 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f0486e55-caf6-4345-a686-2747ef4b5c81 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:17.763571 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f0486e55-caf6-4345-a686-2747ef4b5c81 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:17.764663 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f0486e55-caf6-4345-a686-2747ef4b5c81 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:17.767908 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f0486e55-caf6-4345-a686-2747ef4b5c81 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:17.769510 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f0486e55-caf6-4345-a686-2747ef4b5c81 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:17.770835 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f0486e55-caf6-4345-a686-2747ef4b5c81 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:17.805144 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-8f7f97b2-8ce4-43b8-a960-161cf332df18 req-1083ee88-b90b-408f-8b81-9e76d393da2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20015651-8ebe-44d9-9d4a-b4e15741c295", "name": "network-vif-plugged", "status": "completed", "tag": "4749694d-66d5-4de8-b827-176ffeb49aa3"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:17.826486 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-8f7f97b2-8ce4-43b8-a960-161cf332df18 req-1083ee88-b90b-408f-8b81-9e76d393da2f service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:17.827065 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-8f7f97b2-8ce4-43b8-a960-161cf332df18 req-1083ee88-b90b-408f-8b81-9e76d393da2f service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:17.828196 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-8f7f97b2-8ce4-43b8-a960-161cf332df18 req-1083ee88-b90b-408f-8b81-9e76d393da2f service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:17.854810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-8f7f97b2-8ce4-43b8-a960-161cf332df18 req-1083ee88-b90b-408f-8b81-9e76d393da2f service nova] Creating event network-vif-plugged:4749694d-66d5-4de8-b827-176ffeb49aa3 for instance 20015651-8ebe-44d9-9d4a-b4e15741c295 on hv-cinder-82099 Oct 14 13:00:17.861942 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-8f7f97b2-8ce4-43b8-a960-161cf332df18 req-1083ee88-b90b-408f-8b81-9e76d393da2f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236243 Oct 14 13:00:17.863049 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 24/58] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:00:17.871061 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-095fb724-3472-46c3-9346-6b158c9f4290 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:17.872515 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-095fb724-3472-46c3-9346-6b158c9f4290 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:17.879838 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-095fb724-3472-46c3-9346-6b158c9f4290 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:17.880841 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-095fb724-3472-46c3-9346-6b158c9f4290 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:17.881923 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-095fb724-3472-46c3-9346-6b158c9f4290 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:17.883251 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-095fb724-3472-46c3-9346-6b158c9f4290 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:17.883876 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-095fb724-3472-46c3-9346-6b158c9f4290 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:17.884496 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-095fb724-3472-46c3-9346-6b158c9f4290 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:18.033638 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f0486e55-caf6-4345-a686-2747ef4b5c81 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:18.044714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f0486e55-caf6-4345-a686-2747ef4b5c81 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1315 microversion: 2.1 time: 0.334225 Oct 14 13:00:18.045283 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 35/59] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:17 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:18.117505 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-095fb724-3472-46c3-9346-6b158c9f4290 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:18.128593 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-095fb724-3472-46c3-9346-6b158c9f4290 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1321 microversion: 2.1 time: 0.264149 Oct 14 13:00:18.129661 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 25/60] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:17 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1321 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:18.257848 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-eef62959-0223-4cb4-9eba-7fabb26c2a90 req-860a8623-e2f1-45ba-b49c-03d39ece82c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c6dfd1-715d-4239-a767-32f2e2dcf892", "tag": "ca20794f-a050-45d2-ac62-3d478950e906"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:18.273762 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-eef62959-0223-4cb4-9eba-7fabb26c2a90 req-860a8623-e2f1-45ba-b49c-03d39ece82c2 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:18.274399 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-eef62959-0223-4cb4-9eba-7fabb26c2a90 req-860a8623-e2f1-45ba-b49c-03d39ece82c2 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:18.274825 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-eef62959-0223-4cb4-9eba-7fabb26c2a90 req-860a8623-e2f1-45ba-b49c-03d39ece82c2 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:18.287276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-eef62959-0223-4cb4-9eba-7fabb26c2a90 req-860a8623-e2f1-45ba-b49c-03d39ece82c2 service nova] Creating event network-changed:ca20794f-a050-45d2-ac62-3d478950e906 for instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 on hv-cinder-82099 Oct 14 13:00:18.293608 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-eef62959-0223-4cb4-9eba-7fabb26c2a90 req-860a8623-e2f1-45ba-b49c-03d39ece82c2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039273 Oct 14 13:00:18.295413 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 36/61] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:00:18.649599 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-39bb5554-a13d-4858-a028-60b0c24aae60 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:18.650304 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-39bb5554-a13d-4858-a028-60b0c24aae60 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:18.656554 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39bb5554-a13d-4858-a028-60b0c24aae60 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:18.657133 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39bb5554-a13d-4858-a028-60b0c24aae60 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:18.657868 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39bb5554-a13d-4858-a028-60b0c24aae60 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:18.658740 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39bb5554-a13d-4858-a028-60b0c24aae60 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:18.659504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39bb5554-a13d-4858-a028-60b0c24aae60 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:18.659922 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39bb5554-a13d-4858-a028-60b0c24aae60 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:18.736307 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-64177a34-1ad7-43bc-9350-b27cfa8cb119 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:18.737017 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-64177a34-1ad7-43bc-9350-b27cfa8cb119 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:18.745701 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64177a34-1ad7-43bc-9350-b27cfa8cb119 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:18.746449 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64177a34-1ad7-43bc-9350-b27cfa8cb119 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:18.747062 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64177a34-1ad7-43bc-9350-b27cfa8cb119 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:18.748048 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64177a34-1ad7-43bc-9350-b27cfa8cb119 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:18.748709 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64177a34-1ad7-43bc-9350-b27cfa8cb119 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:18.749329 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64177a34-1ad7-43bc-9350-b27cfa8cb119 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:18.953670 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-39bb5554-a13d-4858-a028-60b0c24aae60 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:18.965185 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-39bb5554-a13d-4858-a028-60b0c24aae60 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1361 microversion: 2.1 time: 0.319526 Oct 14 13:00:18.966688 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 26/62] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:18 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1361 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:19.068373 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-70a4f54e-0786-4e15-8d46-26c0ab946c43 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:19.069279 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-70a4f54e-0786-4e15-8d46-26c0ab946c43 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:19.075362 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:19.077014 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-70a4f54e-0786-4e15-8d46-26c0ab946c43 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:19.077785 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-70a4f54e-0786-4e15-8d46-26c0ab946c43 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:19.078434 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-70a4f54e-0786-4e15-8d46-26c0ab946c43 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:19.079294 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-70a4f54e-0786-4e15-8d46-26c0ab946c43 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:19.079893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-70a4f54e-0786-4e15-8d46-26c0ab946c43 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:19.080565 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-70a4f54e-0786-4e15-8d46-26c0ab946c43 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:19.202822 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-64177a34-1ad7-43bc-9350-b27cfa8cb119 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:19.219424 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-64177a34-1ad7-43bc-9350-b27cfa8cb119 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1365 microversion: 2.1 time: 0.482243 Oct 14 13:00:19.229942 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 37/63] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:18 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1365 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:19.243259 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0aead859-4cbf-488a-a5f0-533bad3bb14e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:19.244248 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0aead859-4cbf-488a-a5f0-533bad3bb14e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:19.251698 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0aead859-4cbf-488a-a5f0-533bad3bb14e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:19.253277 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0aead859-4cbf-488a-a5f0-533bad3bb14e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:19.253945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0aead859-4cbf-488a-a5f0-533bad3bb14e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:19.255195 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0aead859-4cbf-488a-a5f0-533bad3bb14e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:19.255802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0aead859-4cbf-488a-a5f0-533bad3bb14e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:19.256430 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0aead859-4cbf-488a-a5f0-533bad3bb14e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:19.408236 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-70a4f54e-0786-4e15-8d46-26c0ab946c43 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:19.412609 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=100 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:19.417988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-70a4f54e-0786-4e15-8d46-26c0ab946c43 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1315 microversion: 2.1 time: 0.353569 Oct 14 13:00:19.425119 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 27/64] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:19 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:19.835616 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0aead859-4cbf-488a-a5f0-533bad3bb14e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:19.847942 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0aead859-4cbf-488a-a5f0-533bad3bb14e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1321 microversion: 2.1 time: 0.616721 Oct 14 13:00:19.849814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 38/65] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:19 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1321 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:19.882264 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-f32b921a-b0f2-4649-b6aa-9a9269313194 req-26b42bc3-30e2-4d3f-b32a-10bef2489eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b", "name": "network-vif-plugged", "status": "completed", "tag": "5db67f63-ad2c-4649-84c2-af882da8c339"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:19.897018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=6 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:19.904740 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-f32b921a-b0f2-4649-b6aa-9a9269313194 req-26b42bc3-30e2-4d3f-b32a-10bef2489eb8 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:19.906113 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-f32b921a-b0f2-4649-b6aa-9a9269313194 req-26b42bc3-30e2-4d3f-b32a-10bef2489eb8 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:19.907257 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-f32b921a-b0f2-4649-b6aa-9a9269313194 req-26b42bc3-30e2-4d3f-b32a-10bef2489eb8 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:19.925874 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-f32b921a-b0f2-4649-b6aa-9a9269313194 req-26b42bc3-30e2-4d3f-b32a-10bef2489eb8 service nova] Creating event network-vif-plugged:5db67f63-ad2c-4649-84c2-af882da8c339 for instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b on hv-cinder-82099 Oct 14 13:00:19.933531 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-f32b921a-b0f2-4649-b6aa-9a9269313194 req-26b42bc3-30e2-4d3f-b32a-10bef2489eb8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056432 Oct 14 13:00:19.934333 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 28/66] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:00:19.994353 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-43bf28fa-3b45-4b0b-a284-98ad27ffc5d7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:19.995725 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-43bf28fa-3b45-4b0b-a284-98ad27ffc5d7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:20.005783 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-43bf28fa-3b45-4b0b-a284-98ad27ffc5d7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:20.006392 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-43bf28fa-3b45-4b0b-a284-98ad27ffc5d7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:20.007092 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-43bf28fa-3b45-4b0b-a284-98ad27ffc5d7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:20.008044 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-43bf28fa-3b45-4b0b-a284-98ad27ffc5d7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:20.008603 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-43bf28fa-3b45-4b0b-a284-98ad27ffc5d7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:20.009784 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-43bf28fa-3b45-4b0b-a284-98ad27ffc5d7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:20.248814 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-49b1341d-944c-451f-860d-9a8d0b66bdfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:20.249588 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-49b1341d-944c-451f-860d-9a8d0b66bdfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:20.263828 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-49b1341d-944c-451f-860d-9a8d0b66bdfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:20.264302 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-49b1341d-944c-451f-860d-9a8d0b66bdfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:20.264749 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-49b1341d-944c-451f-860d-9a8d0b66bdfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:20.269938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-43bf28fa-3b45-4b0b-a284-98ad27ffc5d7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:20.281647 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-49b1341d-944c-451f-860d-9a8d0b66bdfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:20.289817 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-49b1341d-944c-451f-860d-9a8d0b66bdfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:20.290497 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-49b1341d-944c-451f-860d-9a8d0b66bdfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:20.290980 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-43bf28fa-3b45-4b0b-a284-98ad27ffc5d7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1361 microversion: 2.1 time: 0.298564 Oct 14 13:00:20.292538 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 39/67] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:19 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:20.450442 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-de708a25-532b-4907-8bae-4f9902dc5e14 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:20.451229 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-de708a25-532b-4907-8bae-4f9902dc5e14 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:20.460838 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-de708a25-532b-4907-8bae-4f9902dc5e14 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:20.461563 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-de708a25-532b-4907-8bae-4f9902dc5e14 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:20.462143 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-de708a25-532b-4907-8bae-4f9902dc5e14 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:20.462979 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-de708a25-532b-4907-8bae-4f9902dc5e14 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:20.464277 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-de708a25-532b-4907-8bae-4f9902dc5e14 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:20.464850 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-de708a25-532b-4907-8bae-4f9902dc5e14 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:20.581073 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-49b1341d-944c-451f-860d-9a8d0b66bdfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:20.589203 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-49b1341d-944c-451f-860d-9a8d0b66bdfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1365 microversion: 2.1 time: 0.346167 Oct 14 13:00:20.590316 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 29/68] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:20 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:20.785073 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-de708a25-532b-4907-8bae-4f9902dc5e14 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:20.792943 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-de708a25-532b-4907-8bae-4f9902dc5e14 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1315 microversion: 2.1 time: 0.348147 Oct 14 13:00:20.812427 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 40/69] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:20 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:20.874897 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-547657d2-7ddd-40f7-9cc9-f10950282fe4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:20.875511 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-547657d2-7ddd-40f7-9cc9-f10950282fe4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:20.881596 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-547657d2-7ddd-40f7-9cc9-f10950282fe4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:20.882084 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-547657d2-7ddd-40f7-9cc9-f10950282fe4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:20.882513 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-547657d2-7ddd-40f7-9cc9-f10950282fe4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:20.883376 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-547657d2-7ddd-40f7-9cc9-f10950282fe4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:20.883829 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-547657d2-7ddd-40f7-9cc9-f10950282fe4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:20.884252 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-547657d2-7ddd-40f7-9cc9-f10950282fe4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:21.046960 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-547657d2-7ddd-40f7-9cc9-f10950282fe4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:21.058755 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-547657d2-7ddd-40f7-9cc9-f10950282fe4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1321 microversion: 2.1 time: 0.187463 Oct 14 13:00:21.059392 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 30/70] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:20 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:21.313279 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=8 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:21.318111 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-aeae9694-e7b4-446e-b9ef-dc89ff5d3d51 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:21.318987 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-aeae9694-e7b4-446e-b9ef-dc89ff5d3d51 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:21.326740 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aeae9694-e7b4-446e-b9ef-dc89ff5d3d51 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:21.327356 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aeae9694-e7b4-446e-b9ef-dc89ff5d3d51 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:21.329361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aeae9694-e7b4-446e-b9ef-dc89ff5d3d51 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:21.329361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aeae9694-e7b4-446e-b9ef-dc89ff5d3d51 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:21.329361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aeae9694-e7b4-446e-b9ef-dc89ff5d3d51 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:21.329673 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aeae9694-e7b4-446e-b9ef-dc89ff5d3d51 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:21.508915 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-aeae9694-e7b4-446e-b9ef-dc89ff5d3d51 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:21.520466 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-aeae9694-e7b4-446e-b9ef-dc89ff5d3d51 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1361 microversion: 2.1 time: 0.207515 Oct 14 13:00:21.521335 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 41/71] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:21 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:21.617208 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-11faafbe-419b-46f3-9d58-6fbea4fd6ba0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:21.617956 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-11faafbe-419b-46f3-9d58-6fbea4fd6ba0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:21.621086 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=8 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:21.628714 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-11faafbe-419b-46f3-9d58-6fbea4fd6ba0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:21.629588 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-11faafbe-419b-46f3-9d58-6fbea4fd6ba0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:21.630279 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-11faafbe-419b-46f3-9d58-6fbea4fd6ba0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:21.631199 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-11faafbe-419b-46f3-9d58-6fbea4fd6ba0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:21.632146 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-11faafbe-419b-46f3-9d58-6fbea4fd6ba0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:21.632831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-11faafbe-419b-46f3-9d58-6fbea4fd6ba0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:21.819536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4d02aed9-3148-4565-a3dc-76986c8cf3ce tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:21.822257 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-4d02aed9-3148-4565-a3dc-76986c8cf3ce tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:21.834912 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4d02aed9-3148-4565-a3dc-76986c8cf3ce tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:21.835416 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4d02aed9-3148-4565-a3dc-76986c8cf3ce tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:21.835856 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4d02aed9-3148-4565-a3dc-76986c8cf3ce tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:21.836563 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4d02aed9-3148-4565-a3dc-76986c8cf3ce tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:21.837014 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4d02aed9-3148-4565-a3dc-76986c8cf3ce tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:21.837434 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4d02aed9-3148-4565-a3dc-76986c8cf3ce tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:21.838382 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-11faafbe-419b-46f3-9d58-6fbea4fd6ba0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:21.855187 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-11faafbe-419b-46f3-9d58-6fbea4fd6ba0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1365 microversion: 2.1 time: 0.243108 Oct 14 13:00:21.858009 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 31/72] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:21 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:21.950551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-a748eece-9311-4907-b47b-5389a02b5a87 req-b7c01260-ec13-4584-90c5-63bb7de9344b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad463f3e-be3e-40a0-ad61-6eab6a24f957", "name": "network-vif-plugged", "status": "completed", "tag": "9a1f9cf5-f6ac-458f-991e-d6fcead5660f"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:21.969814 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-a748eece-9311-4907-b47b-5389a02b5a87 req-b7c01260-ec13-4584-90c5-63bb7de9344b service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:21.970593 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-a748eece-9311-4907-b47b-5389a02b5a87 req-b7c01260-ec13-4584-90c5-63bb7de9344b service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:21.971385 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-a748eece-9311-4907-b47b-5389a02b5a87 req-b7c01260-ec13-4584-90c5-63bb7de9344b service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:21.989079 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-a748eece-9311-4907-b47b-5389a02b5a87 req-b7c01260-ec13-4584-90c5-63bb7de9344b service nova] Creating event network-vif-plugged:9a1f9cf5-f6ac-458f-991e-d6fcead5660f for instance ad463f3e-be3e-40a0-ad61-6eab6a24f957 on hv-cinder-82099 Oct 14 13:00:21.995790 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-a748eece-9311-4907-b47b-5389a02b5a87 req-b7c01260-ec13-4584-90c5-63bb7de9344b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049596 Oct 14 13:00:22.000750 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 32/73] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:00:22.087781 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cd27e6f7-afd2-4c94-9469-c5f4b9c903c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:22.089264 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-cd27e6f7-afd2-4c94-9469-c5f4b9c903c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:22.096295 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd27e6f7-afd2-4c94-9469-c5f4b9c903c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:22.097140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd27e6f7-afd2-4c94-9469-c5f4b9c903c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:22.097787 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd27e6f7-afd2-4c94-9469-c5f4b9c903c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:22.098645 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd27e6f7-afd2-4c94-9469-c5f4b9c903c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:22.099247 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd27e6f7-afd2-4c94-9469-c5f4b9c903c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:22.099817 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd27e6f7-afd2-4c94-9469-c5f4b9c903c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:22.165242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-4d02aed9-3148-4565-a3dc-76986c8cf3ce tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:22.176360 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4d02aed9-3148-4565-a3dc-76986c8cf3ce tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1315 microversion: 2.1 time: 0.361293 Oct 14 13:00:22.178120 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 42/74] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:21 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:22.399297 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-cd27e6f7-afd2-4c94-9469-c5f4b9c903c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:22.408070 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-cd27e6f7-afd2-4c94-9469-c5f4b9c903c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1321 microversion: 2.1 time: 0.327950 Oct 14 13:00:22.408835 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 33/75] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:22 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:22.543537 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4de383c0-58b6-4074-ac9a-a05c13003caa tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:22.544864 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-4de383c0-58b6-4074-ac9a-a05c13003caa tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:22.564883 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4de383c0-58b6-4074-ac9a-a05c13003caa tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:22.565906 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4de383c0-58b6-4074-ac9a-a05c13003caa tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:22.566339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4de383c0-58b6-4074-ac9a-a05c13003caa tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:22.567127 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4de383c0-58b6-4074-ac9a-a05c13003caa tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:22.567784 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4de383c0-58b6-4074-ac9a-a05c13003caa tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:22.568393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4de383c0-58b6-4074-ac9a-a05c13003caa tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:22.874328 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=4 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:22.889417 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5564494b-b4a8-4b90-9022-6d3345eb72d9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:22.891154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5564494b-b4a8-4b90-9022-6d3345eb72d9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:22.902227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5564494b-b4a8-4b90-9022-6d3345eb72d9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:22.903028 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5564494b-b4a8-4b90-9022-6d3345eb72d9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:22.904236 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5564494b-b4a8-4b90-9022-6d3345eb72d9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:22.907353 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5564494b-b4a8-4b90-9022-6d3345eb72d9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:22.908031 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5564494b-b4a8-4b90-9022-6d3345eb72d9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:22.909137 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5564494b-b4a8-4b90-9022-6d3345eb72d9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:22.971466 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-4de383c0-58b6-4074-ac9a-a05c13003caa tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:22.989287 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4de383c0-58b6-4074-ac9a-a05c13003caa tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1361 microversion: 2.1 time: 0.449476 Oct 14 13:00:23.009280 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 43/76] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:22 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1361 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:23.176142 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-5564494b-b4a8-4b90-9022-6d3345eb72d9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:23.189161 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5564494b-b4a8-4b90-9022-6d3345eb72d9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1365 microversion: 2.1 time: 0.309450 Oct 14 13:00:23.189821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 34/77] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:22 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1365 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:23.200326 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1067ab74-7a32-4e47-852f-d17b95fec22a tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:23.201184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1067ab74-7a32-4e47-852f-d17b95fec22a tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:23.210931 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1067ab74-7a32-4e47-852f-d17b95fec22a tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:23.211404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1067ab74-7a32-4e47-852f-d17b95fec22a tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:23.211896 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1067ab74-7a32-4e47-852f-d17b95fec22a tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:23.212510 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1067ab74-7a32-4e47-852f-d17b95fec22a tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:23.213010 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1067ab74-7a32-4e47-852f-d17b95fec22a tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:23.213468 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1067ab74-7a32-4e47-852f-d17b95fec22a tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:23.438069 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-1067ab74-7a32-4e47-852f-d17b95fec22a tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:23.442508 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-06cc668f-add0-4627-a2ec-b241c4d21245 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:23.443119 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-06cc668f-add0-4627-a2ec-b241c4d21245 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:23.451555 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1067ab74-7a32-4e47-852f-d17b95fec22a tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1502 microversion: 2.1 time: 0.256078 Oct 14 13:00:23.456081 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06cc668f-add0-4627-a2ec-b241c4d21245 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:23.456513 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 44/78] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:23 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1502 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:23.457161 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06cc668f-add0-4627-a2ec-b241c4d21245 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:23.458354 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06cc668f-add0-4627-a2ec-b241c4d21245 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:23.459250 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06cc668f-add0-4627-a2ec-b241c4d21245 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:23.459842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06cc668f-add0-4627-a2ec-b241c4d21245 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:23.460505 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06cc668f-add0-4627-a2ec-b241c4d21245 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:23.782628 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-06cc668f-add0-4627-a2ec-b241c4d21245 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:23.803565 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-06cc668f-add0-4627-a2ec-b241c4d21245 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1321 microversion: 2.1 time: 0.371205 Oct 14 13:00:23.804144 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 35/79] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:23 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:24.017225 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5db1150e-beb5-4b3a-9d37-8b9134ffde58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:24.017920 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5db1150e-beb5-4b3a-9d37-8b9134ffde58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:24.027996 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5db1150e-beb5-4b3a-9d37-8b9134ffde58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:24.028426 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5db1150e-beb5-4b3a-9d37-8b9134ffde58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:24.028874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5db1150e-beb5-4b3a-9d37-8b9134ffde58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:24.031049 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5db1150e-beb5-4b3a-9d37-8b9134ffde58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:24.031513 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5db1150e-beb5-4b3a-9d37-8b9134ffde58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:24.033594 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5db1150e-beb5-4b3a-9d37-8b9134ffde58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:24.200195 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5db1150e-beb5-4b3a-9d37-8b9134ffde58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:24.211616 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5db1150e-beb5-4b3a-9d37-8b9134ffde58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1361 microversion: 2.1 time: 0.198608 Oct 14 13:00:24.212199 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 45/80] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:24 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:24.212727 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-54276622-831a-49d0-b5e2-7628c7a73e42 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:24.213420 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-54276622-831a-49d0-b5e2-7628c7a73e42 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:24.220762 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54276622-831a-49d0-b5e2-7628c7a73e42 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:24.221440 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54276622-831a-49d0-b5e2-7628c7a73e42 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:24.222111 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54276622-831a-49d0-b5e2-7628c7a73e42 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:24.222955 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54276622-831a-49d0-b5e2-7628c7a73e42 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:24.223544 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54276622-831a-49d0-b5e2-7628c7a73e42 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:24.224437 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54276622-831a-49d0-b5e2-7628c7a73e42 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:24.409249 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-54276622-831a-49d0-b5e2-7628c7a73e42 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:24.421832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-54276622-831a-49d0-b5e2-7628c7a73e42 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1365 microversion: 2.1 time: 0.213472 Oct 14 13:00:24.434408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 36/81] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:24 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:24.527414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-7fb29b79-7e80-4254-9a69-a40344bc19a0 req-f4720854-c43c-42d7-a923-09a5be347ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defcc0c0-d0f4-4913-899d-4d20b75896d6", "name": "network-vif-plugged", "status": "completed", "tag": "1f5e8c9c-50a5-47d9-a8b7-c42df0f5a568"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:24.550155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-7fb29b79-7e80-4254-9a69-a40344bc19a0 req-f4720854-c43c-42d7-a923-09a5be347ec8 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:24.550664 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-7fb29b79-7e80-4254-9a69-a40344bc19a0 req-f4720854-c43c-42d7-a923-09a5be347ec8 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:24.551135 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-7fb29b79-7e80-4254-9a69-a40344bc19a0 req-f4720854-c43c-42d7-a923-09a5be347ec8 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:24.562670 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-7fb29b79-7e80-4254-9a69-a40344bc19a0 req-f4720854-c43c-42d7-a923-09a5be347ec8 service nova] Creating event network-vif-plugged:1f5e8c9c-50a5-47d9-a8b7-c42df0f5a568 for instance defcc0c0-d0f4-4913-899d-4d20b75896d6 on hv-cinder-82099 Oct 14 13:00:24.567989 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-7fb29b79-7e80-4254-9a69-a40344bc19a0 req-f4720854-c43c-42d7-a923-09a5be347ec8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049250 Oct 14 13:00:24.569326 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 46/82] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:00:24.830765 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-dc50a955-7c43-414d-8449-2ec67225ca99 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:24.831656 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-dc50a955-7c43-414d-8449-2ec67225ca99 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:24.837998 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dc50a955-7c43-414d-8449-2ec67225ca99 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:24.842128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dc50a955-7c43-414d-8449-2ec67225ca99 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:24.842785 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dc50a955-7c43-414d-8449-2ec67225ca99 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:24.843499 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dc50a955-7c43-414d-8449-2ec67225ca99 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:24.843945 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dc50a955-7c43-414d-8449-2ec67225ca99 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:24.845625 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dc50a955-7c43-414d-8449-2ec67225ca99 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:24.984336 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4ea74dd3-8154-4a59-a9ef-6a216f00652b tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8afc047c-02d7-493b-a4c1-c7a7deabcbb4"}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:24.986800 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-4ea74dd3-8154-4a59-a9ef-6a216f00652b tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:24.996618 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4ea74dd3-8154-4a59-a9ef-6a216f00652b tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:24.997259 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4ea74dd3-8154-4a59-a9ef-6a216f00652b tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:24.997865 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4ea74dd3-8154-4a59-a9ef-6a216f00652b tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:24.998883 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4ea74dd3-8154-4a59-a9ef-6a216f00652b tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:24.999476 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4ea74dd3-8154-4a59-a9ef-6a216f00652b tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:25.000037 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4ea74dd3-8154-4a59-a9ef-6a216f00652b tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:25.100898 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=100 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:25.158720 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-dc50a955-7c43-414d-8449-2ec67225ca99 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:25.168657 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-dc50a955-7c43-414d-8449-2ec67225ca99 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1514 microversion: 2.1 time: 0.342697 Oct 14 13:00:25.176741 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 37/83] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:24 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1514 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:25.197129 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-156b70fd-d515-4aa5-808d-1b66cfb0d695 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:25.200468 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-156b70fd-d515-4aa5-808d-1b66cfb0d695 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:25.210627 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-156b70fd-d515-4aa5-808d-1b66cfb0d695 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:25.211125 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-156b70fd-d515-4aa5-808d-1b66cfb0d695 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:25.211563 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-156b70fd-d515-4aa5-808d-1b66cfb0d695 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:25.212547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-156b70fd-d515-4aa5-808d-1b66cfb0d695 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:25.213013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-156b70fd-d515-4aa5-808d-1b66cfb0d695 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:25.214407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-156b70fd-d515-4aa5-808d-1b66cfb0d695 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:25.296363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-156b70fd-d515-4aa5-808d-1b66cfb0d695 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lazy-loading 'flavor' on Instance uuid ad463f3e-be3e-40a0-ad61-6eab6a24f957 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:00:25.423366 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-156b70fd-d515-4aa5-808d-1b66cfb0d695 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "POST /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957/action" status: 200 len: 32 microversion: 2.1 time: 0.234089 Oct 14 13:00:25.424476 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 38/84] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Oct 14 13:00:25 2022] POST /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957/action => generated 32 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 13:00:25.430944 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-03400ceb-c604-4e62-9d41-268d011c3bc9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:25.431651 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-03400ceb-c604-4e62-9d41-268d011c3bc9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:25.440180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-03400ceb-c604-4e62-9d41-268d011c3bc9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:25.441000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-03400ceb-c604-4e62-9d41-268d011c3bc9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:25.441700 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-03400ceb-c604-4e62-9d41-268d011c3bc9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:25.442600 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-03400ceb-c604-4e62-9d41-268d011c3bc9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:25.443201 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-03400ceb-c604-4e62-9d41-268d011c3bc9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:25.443757 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-03400ceb-c604-4e62-9d41-268d011c3bc9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:25.621525 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-03400ceb-c604-4e62-9d41-268d011c3bc9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:25.632030 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-03400ceb-c604-4e62-9d41-268d011c3bc9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1361 microversion: 2.1 time: 0.203267 Oct 14 13:00:25.632647 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 39/85] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:25 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:25.642310 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e09b70a3-5231-4672-be59-fdb9e2acdfd5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:25.653517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e09b70a3-5231-4672-be59-fdb9e2acdfd5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:25.659891 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e09b70a3-5231-4672-be59-fdb9e2acdfd5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:25.660519 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e09b70a3-5231-4672-be59-fdb9e2acdfd5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:25.661062 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e09b70a3-5231-4672-be59-fdb9e2acdfd5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:25.661889 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e09b70a3-5231-4672-be59-fdb9e2acdfd5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:25.662439 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e09b70a3-5231-4672-be59-fdb9e2acdfd5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:25.663080 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e09b70a3-5231-4672-be59-fdb9e2acdfd5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:25.778442 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4ea74dd3-8154-4a59-a9ef-6a216f00652b tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "POST /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.798228 Oct 14 13:00:25.779076 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 47/86] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Oct 14 13:00:24 2022] POST /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b/os-volume_attachments => generated 194 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:00:25.784643 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c808739d-8646-4eaa-85ea-56aa90f53aaf tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:25.785356 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c808739d-8646-4eaa-85ea-56aa90f53aaf tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:25.800717 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c808739d-8646-4eaa-85ea-56aa90f53aaf tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:25.801204 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c808739d-8646-4eaa-85ea-56aa90f53aaf tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:25.801669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c808739d-8646-4eaa-85ea-56aa90f53aaf tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:25.802432 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c808739d-8646-4eaa-85ea-56aa90f53aaf tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:25.802887 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c808739d-8646-4eaa-85ea-56aa90f53aaf tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:25.803406 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c808739d-8646-4eaa-85ea-56aa90f53aaf tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:25.857169 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e09b70a3-5231-4672-be59-fdb9e2acdfd5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:25.865348 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e09b70a3-5231-4672-be59-fdb9e2acdfd5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.226744 Oct 14 13:00:25.866420 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 40/87] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:25 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:26.003102 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c808739d-8646-4eaa-85ea-56aa90f53aaf tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:26.010994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c808739d-8646-4eaa-85ea-56aa90f53aaf tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1365 microversion: 2.1 time: 0.230792 Oct 14 13:00:26.011555 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 48/88] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:25 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1365 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:26.599934 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-efdb6045-9aef-42b6-b5c4-1bbbd0dd1b2d req-5ee5740c-3f6c-4c5d-9900-9068c679cfed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c6dfd1-715d-4239-a767-32f2e2dcf892", "name": "network-vif-plugged", "status": "completed", "tag": "ca20794f-a050-45d2-ac62-3d478950e906"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:26.614732 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-efdb6045-9aef-42b6-b5c4-1bbbd0dd1b2d req-5ee5740c-3f6c-4c5d-9900-9068c679cfed service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:26.615438 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-efdb6045-9aef-42b6-b5c4-1bbbd0dd1b2d req-5ee5740c-3f6c-4c5d-9900-9068c679cfed service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:26.616035 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-efdb6045-9aef-42b6-b5c4-1bbbd0dd1b2d req-5ee5740c-3f6c-4c5d-9900-9068c679cfed service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:26.631070 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-efdb6045-9aef-42b6-b5c4-1bbbd0dd1b2d req-5ee5740c-3f6c-4c5d-9900-9068c679cfed service nova] Creating event network-vif-plugged:ca20794f-a050-45d2-ac62-3d478950e906 for instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 on hv-cinder-82099 Oct 14 13:00:26.636886 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-efdb6045-9aef-42b6-b5c4-1bbbd0dd1b2d req-5ee5740c-3f6c-4c5d-9900-9068c679cfed service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041695 Oct 14 13:00:26.637718 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 41/89] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:00:26.658152 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d21c1b15-a345-4832-b3ca-9479bb8c8c35 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:26.659010 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-d21c1b15-a345-4832-b3ca-9479bb8c8c35 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:26.671895 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d21c1b15-a345-4832-b3ca-9479bb8c8c35 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:26.672515 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d21c1b15-a345-4832-b3ca-9479bb8c8c35 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:26.672831 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d21c1b15-a345-4832-b3ca-9479bb8c8c35 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:26.674322 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d21c1b15-a345-4832-b3ca-9479bb8c8c35 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:26.674775 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d21c1b15-a345-4832-b3ca-9479bb8c8c35 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:26.675195 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d21c1b15-a345-4832-b3ca-9479bb8c8c35 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:26.863797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-d21c1b15-a345-4832-b3ca-9479bb8c8c35 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:26.872130 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-d21c1b15-a345-4832-b3ca-9479bb8c8c35 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1361 microversion: 2.1 time: 0.219943 Oct 14 13:00:26.872975 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 49/90] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:26 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:26.904745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c92c7f5a-6267-4658-8c62-89740c012037 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:26.905775 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c92c7f5a-6267-4658-8c62-89740c012037 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:26.921136 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c92c7f5a-6267-4658-8c62-89740c012037 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:26.921980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c92c7f5a-6267-4658-8c62-89740c012037 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:26.922420 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c92c7f5a-6267-4658-8c62-89740c012037 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:26.926098 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c92c7f5a-6267-4658-8c62-89740c012037 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:26.927188 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c92c7f5a-6267-4658-8c62-89740c012037 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:26.928697 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c92c7f5a-6267-4658-8c62-89740c012037 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:27.037522 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-3d8eeee0-d461-4c66-a9d0-64cfea2fd355 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:27.038293 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-3d8eeee0-d461-4c66-a9d0-64cfea2fd355 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:27.050218 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3d8eeee0-d461-4c66-a9d0-64cfea2fd355 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:27.052307 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3d8eeee0-d461-4c66-a9d0-64cfea2fd355 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:27.052920 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3d8eeee0-d461-4c66-a9d0-64cfea2fd355 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:27.054710 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3d8eeee0-d461-4c66-a9d0-64cfea2fd355 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:27.055228 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3d8eeee0-d461-4c66-a9d0-64cfea2fd355 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:27.055747 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3d8eeee0-d461-4c66-a9d0-64cfea2fd355 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:27.233183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3d8eeee0-d461-4c66-a9d0-64cfea2fd355 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:27.239595 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c92c7f5a-6267-4658-8c62-89740c012037 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:27.248174 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c92c7f5a-6267-4658-8c62-89740c012037 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.357319 Oct 14 13:00:27.249049 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-3d8eeee0-d461-4c66-a9d0-64cfea2fd355 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1554 microversion: 2.1 time: 0.216487 Oct 14 13:00:27.250705 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 50/91] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:27 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1554 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:27.253078 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 42/92] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:26 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:27.276661 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2b4db5d5-4484-468f-b927-2a68f8fa9a46 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:27.277215 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2b4db5d5-4484-468f-b927-2a68f8fa9a46 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:27.294669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2b4db5d5-4484-468f-b927-2a68f8fa9a46 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:27.295361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2b4db5d5-4484-468f-b927-2a68f8fa9a46 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:27.295987 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2b4db5d5-4484-468f-b927-2a68f8fa9a46 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:27.296831 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2b4db5d5-4484-468f-b927-2a68f8fa9a46 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:27.297547 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2b4db5d5-4484-468f-b927-2a68f8fa9a46 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:27.298101 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2b4db5d5-4484-468f-b927-2a68f8fa9a46 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:27.518711 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2b4db5d5-4484-468f-b927-2a68f8fa9a46 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.248535 Oct 14 13:00:27.521176 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 51/93] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Oct 14 13:00:27 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6/os-interface => generated 284 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:00:27.895534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c8552b73-3acb-438e-b9af-939526df5385 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:27.896126 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c8552b73-3acb-438e-b9af-939526df5385 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:27.902947 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c8552b73-3acb-438e-b9af-939526df5385 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:27.903724 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c8552b73-3acb-438e-b9af-939526df5385 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:27.904655 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c8552b73-3acb-438e-b9af-939526df5385 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:27.905798 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c8552b73-3acb-438e-b9af-939526df5385 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:27.906476 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c8552b73-3acb-438e-b9af-939526df5385 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:27.907946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c8552b73-3acb-438e-b9af-939526df5385 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:28.138002 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c8552b73-3acb-438e-b9af-939526df5385 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:28.146481 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c8552b73-3acb-438e-b9af-939526df5385 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1361 microversion: 2.1 time: 0.254763 Oct 14 13:00:28.147196 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 43/94] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:27 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:28.278681 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d3ef4359-c2b8-4b0c-9ae6-d12915f28514 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:28.279331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-d3ef4359-c2b8-4b0c-9ae6-d12915f28514 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:28.286722 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d3ef4359-c2b8-4b0c-9ae6-d12915f28514 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:28.287217 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d3ef4359-c2b8-4b0c-9ae6-d12915f28514 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:28.287654 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d3ef4359-c2b8-4b0c-9ae6-d12915f28514 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:28.288454 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d3ef4359-c2b8-4b0c-9ae6-d12915f28514 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:28.288796 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d3ef4359-c2b8-4b0c-9ae6-d12915f28514 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:28.289223 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d3ef4359-c2b8-4b0c-9ae6-d12915f28514 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:28.645761 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-d3ef4359-c2b8-4b0c-9ae6-d12915f28514 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:28.654332 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-d3ef4359-c2b8-4b0c-9ae6-d12915f28514 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.381228 Oct 14 13:00:28.658325 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 52/95] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:28 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:29.174951 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2d3588bb-3e79-4aea-83dd-d49d4c004ffb tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:29.176186 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-2d3588bb-3e79-4aea-83dd-d49d4c004ffb tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:29.186004 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2d3588bb-3e79-4aea-83dd-d49d4c004ffb tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:29.189302 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2d3588bb-3e79-4aea-83dd-d49d4c004ffb tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:29.191983 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2d3588bb-3e79-4aea-83dd-d49d4c004ffb tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:29.192913 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2d3588bb-3e79-4aea-83dd-d49d4c004ffb tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:29.193658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2d3588bb-3e79-4aea-83dd-d49d4c004ffb tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:29.197247 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2d3588bb-3e79-4aea-83dd-d49d4c004ffb tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:29.211897 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-8bb2528e-f574-4289-95a2-41bc47f65fd3 req-7dbe7212-a731-4059-83bf-232f4f9a1f8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "defcc0c0-d0f4-4913-899d-4d20b75896d6", "tag": "1f5e8c9c-50a5-47d9-a8b7-c42df0f5a568"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:29.248845 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-8bb2528e-f574-4289-95a2-41bc47f65fd3 req-7dbe7212-a731-4059-83bf-232f4f9a1f8c service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:29.252031 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-8bb2528e-f574-4289-95a2-41bc47f65fd3 req-7dbe7212-a731-4059-83bf-232f4f9a1f8c service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:29.254003 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-8bb2528e-f574-4289-95a2-41bc47f65fd3 req-7dbe7212-a731-4059-83bf-232f4f9a1f8c service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:29.299778 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:29.313934 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-8bb2528e-f574-4289-95a2-41bc47f65fd3 req-7dbe7212-a731-4059-83bf-232f4f9a1f8c service nova] Creating event network-changed:1f5e8c9c-50a5-47d9-a8b7-c42df0f5a568 for instance defcc0c0-d0f4-4913-899d-4d20b75896d6 on hv-cinder-82099 Oct 14 13:00:29.320489 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-8bb2528e-f574-4289-95a2-41bc47f65fd3 req-7dbe7212-a731-4059-83bf-232f4f9a1f8c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112124 Oct 14 13:00:29.326370 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 53/96] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:00:29.485673 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-2d3588bb-3e79-4aea-83dd-d49d4c004ffb tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:29.494711 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-2d3588bb-3e79-4aea-83dd-d49d4c004ffb tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1361 microversion: 2.1 time: 0.324017 Oct 14 13:00:29.510513 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 44/97] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:29 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1361 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:29.682303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2118ed92-9b56-407d-8ec8-05509263960e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:29.683261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2118ed92-9b56-407d-8ec8-05509263960e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:29.693218 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2118ed92-9b56-407d-8ec8-05509263960e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:29.693785 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2118ed92-9b56-407d-8ec8-05509263960e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:29.699588 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2118ed92-9b56-407d-8ec8-05509263960e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:29.701413 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2118ed92-9b56-407d-8ec8-05509263960e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:29.702137 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2118ed92-9b56-407d-8ec8-05509263960e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:29.702975 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2118ed92-9b56-407d-8ec8-05509263960e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:29.956861 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2118ed92-9b56-407d-8ec8-05509263960e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:29.977794 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2118ed92-9b56-407d-8ec8-05509263960e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.300276 Oct 14 13:00:29.980433 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 54/98] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:29 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:30.526731 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c2bd135e-244f-49aa-9e68-cf762d996710 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:30.530893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c2bd135e-244f-49aa-9e68-cf762d996710 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:30.537796 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c2bd135e-244f-49aa-9e68-cf762d996710 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:30.538343 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c2bd135e-244f-49aa-9e68-cf762d996710 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:30.539807 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c2bd135e-244f-49aa-9e68-cf762d996710 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:30.540785 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c2bd135e-244f-49aa-9e68-cf762d996710 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:30.541737 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c2bd135e-244f-49aa-9e68-cf762d996710 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:30.542397 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c2bd135e-244f-49aa-9e68-cf762d996710 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:30.758882 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c2bd135e-244f-49aa-9e68-cf762d996710 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:30.774427 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c2bd135e-244f-49aa-9e68-cf762d996710 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1547 microversion: 2.1 time: 0.258172 Oct 14 13:00:30.775876 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 45/99] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:30 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1547 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:30.801314 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-322177e9-08a8-48c5-b4af-a62e59768004 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:30.803214 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-322177e9-08a8-48c5-b4af-a62e59768004 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:30.811198 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-322177e9-08a8-48c5-b4af-a62e59768004 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:30.811688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-322177e9-08a8-48c5-b4af-a62e59768004 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:30.812295 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-322177e9-08a8-48c5-b4af-a62e59768004 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:30.813157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-322177e9-08a8-48c5-b4af-a62e59768004 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:30.813793 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-322177e9-08a8-48c5-b4af-a62e59768004 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:30.814364 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-322177e9-08a8-48c5-b4af-a62e59768004 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:30.930561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-322177e9-08a8-48c5-b4af-a62e59768004 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134138 Oct 14 13:00:30.932462 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 55/100] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Oct 14 13:00:30 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:00:31.006143 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7f8711a7-ac5a-42b3-9a0e-8e71b49b8b86 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:31.006848 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7f8711a7-ac5a-42b3-9a0e-8e71b49b8b86 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:31.018325 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7f8711a7-ac5a-42b3-9a0e-8e71b49b8b86 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:31.018819 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7f8711a7-ac5a-42b3-9a0e-8e71b49b8b86 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:31.019255 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7f8711a7-ac5a-42b3-9a0e-8e71b49b8b86 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:31.019971 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7f8711a7-ac5a-42b3-9a0e-8e71b49b8b86 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:31.020429 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7f8711a7-ac5a-42b3-9a0e-8e71b49b8b86 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:31.020859 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7f8711a7-ac5a-42b3-9a0e-8e71b49b8b86 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:31.210251 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7f8711a7-ac5a-42b3-9a0e-8e71b49b8b86 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:31.220583 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7f8711a7-ac5a-42b3-9a0e-8e71b49b8b86 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.218222 Oct 14 13:00:31.221913 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 46/101] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:31 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:32.249852 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ade5a755-1f57-49bb-9088-3ae65569bec4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:32.251643 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-ade5a755-1f57-49bb-9088-3ae65569bec4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:32.261902 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ade5a755-1f57-49bb-9088-3ae65569bec4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:32.263042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ade5a755-1f57-49bb-9088-3ae65569bec4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:32.264008 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ade5a755-1f57-49bb-9088-3ae65569bec4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:32.264723 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ade5a755-1f57-49bb-9088-3ae65569bec4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:32.265180 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ade5a755-1f57-49bb-9088-3ae65569bec4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:32.265719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ade5a755-1f57-49bb-9088-3ae65569bec4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:32.326714 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-38c1cee9-9e14-4ef9-8fd3-8e586515779b req-17f528c8-c1fe-41a9-8dcb-2f0bd56cc553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24c6dfd1-715d-4239-a767-32f2e2dcf892", "tag": "ca20794f-a050-45d2-ac62-3d478950e906"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:32.341747 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-38c1cee9-9e14-4ef9-8fd3-8e586515779b req-17f528c8-c1fe-41a9-8dcb-2f0bd56cc553 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:32.344898 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-38c1cee9-9e14-4ef9-8fd3-8e586515779b req-17f528c8-c1fe-41a9-8dcb-2f0bd56cc553 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:32.346115 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-38c1cee9-9e14-4ef9-8fd3-8e586515779b req-17f528c8-c1fe-41a9-8dcb-2f0bd56cc553 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:32.360624 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-38c1cee9-9e14-4ef9-8fd3-8e586515779b req-17f528c8-c1fe-41a9-8dcb-2f0bd56cc553 service nova] Creating event network-changed:ca20794f-a050-45d2-ac62-3d478950e906 for instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 on hv-cinder-82099 Oct 14 13:00:32.366704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-38c1cee9-9e14-4ef9-8fd3-8e586515779b req-17f528c8-c1fe-41a9-8dcb-2f0bd56cc553 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043549 Oct 14 13:00:32.368047 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 47/102] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:00:32.465508 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ade5a755-1f57-49bb-9088-3ae65569bec4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:32.474789 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ade5a755-1f57-49bb-9088-3ae65569bec4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.232581 Oct 14 13:00:32.475424 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 56/103] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:32 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:33.501943 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-91f05e46-346c-4a49-b986-b405aa9a7d66 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:33.503323 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-91f05e46-346c-4a49-b986-b405aa9a7d66 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:33.511329 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-91f05e46-346c-4a49-b986-b405aa9a7d66 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:33.512150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-91f05e46-346c-4a49-b986-b405aa9a7d66 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:33.512767 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-91f05e46-346c-4a49-b986-b405aa9a7d66 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:33.516315 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-91f05e46-346c-4a49-b986-b405aa9a7d66 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:33.517339 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-91f05e46-346c-4a49-b986-b405aa9a7d66 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:33.519917 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-91f05e46-346c-4a49-b986-b405aa9a7d66 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:33.732737 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-91f05e46-346c-4a49-b986-b405aa9a7d66 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:33.752883 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-91f05e46-346c-4a49-b986-b405aa9a7d66 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.257148 Oct 14 13:00:33.765856 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 48/104] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:33 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:34.788111 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-18c4248a-9858-4881-a729-6e149cf24eb1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:34.788837 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-18c4248a-9858-4881-a729-6e149cf24eb1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:34.795661 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-18c4248a-9858-4881-a729-6e149cf24eb1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:34.796136 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-18c4248a-9858-4881-a729-6e149cf24eb1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:34.796557 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-18c4248a-9858-4881-a729-6e149cf24eb1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:34.797679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-18c4248a-9858-4881-a729-6e149cf24eb1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:34.798120 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-18c4248a-9858-4881-a729-6e149cf24eb1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:34.799002 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-18c4248a-9858-4881-a729-6e149cf24eb1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:35.006490 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-18c4248a-9858-4881-a729-6e149cf24eb1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:35.015128 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-18c4248a-9858-4881-a729-6e149cf24eb1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.230959 Oct 14 13:00:35.015697 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 57/105] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:34 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:35.022681 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-645080aa-2baa-4172-bd84-4152df18ee87 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:35.023300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-645080aa-2baa-4172-bd84-4152df18ee87 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:35.031202 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-645080aa-2baa-4172-bd84-4152df18ee87 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:35.031691 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-645080aa-2baa-4172-bd84-4152df18ee87 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:35.032157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-645080aa-2baa-4172-bd84-4152df18ee87 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:35.033875 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-645080aa-2baa-4172-bd84-4152df18ee87 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:35.034337 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-645080aa-2baa-4172-bd84-4152df18ee87 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:35.034751 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-645080aa-2baa-4172-bd84-4152df18ee87 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:35.062394 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-645080aa-2baa-4172-bd84-4152df18ee87 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Going to try to terminate instance {{(pid=118869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:00:35.178228 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-645080aa-2baa-4172-bd84-4152df18ee87 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 204 len: 0 microversion: 2.1 time: 0.159266 Oct 14 13:00:35.179130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 49/106] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:00:35 2022] DELETE /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:00:35.187523 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-92c312ec-5bc7-46db-a458-91046a883923 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:35.188200 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-92c312ec-5bc7-46db-a458-91046a883923 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:35.194018 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-92c312ec-5bc7-46db-a458-91046a883923 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:35.194673 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-92c312ec-5bc7-46db-a458-91046a883923 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:35.195127 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-92c312ec-5bc7-46db-a458-91046a883923 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:35.195927 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-92c312ec-5bc7-46db-a458-91046a883923 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:35.196372 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-92c312ec-5bc7-46db-a458-91046a883923 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:35.196977 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-92c312ec-5bc7-46db-a458-91046a883923 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:35.343853 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-92c312ec-5bc7-46db-a458-91046a883923 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:35.352897 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-92c312ec-5bc7-46db-a458-91046a883923 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1554 microversion: 2.1 time: 0.169483 Oct 14 13:00:35.369591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 58/107] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:35 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:36.040982 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e91fe48f-bbdc-44ae-b7be-ebd6ef78d5eb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:36.042846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e91fe48f-bbdc-44ae-b7be-ebd6ef78d5eb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:36.053187 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e91fe48f-bbdc-44ae-b7be-ebd6ef78d5eb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:36.054013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e91fe48f-bbdc-44ae-b7be-ebd6ef78d5eb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:36.054699 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e91fe48f-bbdc-44ae-b7be-ebd6ef78d5eb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:36.055711 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e91fe48f-bbdc-44ae-b7be-ebd6ef78d5eb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:36.056316 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e91fe48f-bbdc-44ae-b7be-ebd6ef78d5eb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:36.056920 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e91fe48f-bbdc-44ae-b7be-ebd6ef78d5eb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:36.237949 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e91fe48f-bbdc-44ae-b7be-ebd6ef78d5eb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:36.247737 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e91fe48f-bbdc-44ae-b7be-ebd6ef78d5eb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.213080 Oct 14 13:00:36.251007 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 50/108] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:36 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:36.376427 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-12866420-cc40-4f45-b83c-eacae80c9f9f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:36.377727 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-12866420-cc40-4f45-b83c-eacae80c9f9f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:36.389546 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-12866420-cc40-4f45-b83c-eacae80c9f9f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:36.390561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-12866420-cc40-4f45-b83c-eacae80c9f9f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:36.391535 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-12866420-cc40-4f45-b83c-eacae80c9f9f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:36.392705 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-12866420-cc40-4f45-b83c-eacae80c9f9f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:36.393303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-12866420-cc40-4f45-b83c-eacae80c9f9f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:36.393997 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-12866420-cc40-4f45-b83c-eacae80c9f9f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:36.616154 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-12866420-cc40-4f45-b83c-eacae80c9f9f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:36.625999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-12866420-cc40-4f45-b83c-eacae80c9f9f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1554 microversion: 2.1 time: 0.253305 Oct 14 13:00:36.626578 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 59/109] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:36 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:37.277048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-07771340-0f45-4261-a216-a605114dd18a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:37.278223 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-07771340-0f45-4261-a216-a605114dd18a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:37.285282 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07771340-0f45-4261-a216-a605114dd18a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:37.285915 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07771340-0f45-4261-a216-a605114dd18a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:37.286463 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07771340-0f45-4261-a216-a605114dd18a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:37.287603 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07771340-0f45-4261-a216-a605114dd18a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:37.288165 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07771340-0f45-4261-a216-a605114dd18a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:37.288657 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07771340-0f45-4261-a216-a605114dd18a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:37.433182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-07771340-0f45-4261-a216-a605114dd18a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:37.442729 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-07771340-0f45-4261-a216-a605114dd18a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.170829 Oct 14 13:00:37.443496 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 51/110] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:37 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:37.652681 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5d68d42a-b81d-414a-ab5e-6b9d67af75ae tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:37.655392 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5d68d42a-b81d-414a-ab5e-6b9d67af75ae tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:37.665623 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5d68d42a-b81d-414a-ab5e-6b9d67af75ae tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:37.666405 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5d68d42a-b81d-414a-ab5e-6b9d67af75ae tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:37.667186 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5d68d42a-b81d-414a-ab5e-6b9d67af75ae tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:37.668599 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5d68d42a-b81d-414a-ab5e-6b9d67af75ae tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:37.669389 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5d68d42a-b81d-414a-ab5e-6b9d67af75ae tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:37.669837 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5d68d42a-b81d-414a-ab5e-6b9d67af75ae tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:37.849234 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5d68d42a-b81d-414a-ab5e-6b9d67af75ae tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:37.865063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-205a0fc2-bc31-46a9-b2fc-72efccbb9d0e req-3e973749-1042-4f10-84de-18dbcd58c365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b", "name": "network-vif-deleted", "tag": "5db67f63-ad2c-4649-84c2-af882da8c339"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:37.866253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5d68d42a-b81d-414a-ab5e-6b9d67af75ae tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1512 microversion: 2.1 time: 0.219041 Oct 14 13:00:37.876061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 60/111] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:37 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:37.894347 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-205a0fc2-bc31-46a9-b2fc-72efccbb9d0e req-3e973749-1042-4f10-84de-18dbcd58c365 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:37.895164 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-205a0fc2-bc31-46a9-b2fc-72efccbb9d0e req-3e973749-1042-4f10-84de-18dbcd58c365 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:37.896412 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-205a0fc2-bc31-46a9-b2fc-72efccbb9d0e req-3e973749-1042-4f10-84de-18dbcd58c365 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:37.929649 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-205a0fc2-bc31-46a9-b2fc-72efccbb9d0e req-3e973749-1042-4f10-84de-18dbcd58c365 service nova] Creating event network-vif-deleted:5db67f63-ad2c-4649-84c2-af882da8c339 for instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b on hv-cinder-82099 Oct 14 13:00:37.942442 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-205a0fc2-bc31-46a9-b2fc-72efccbb9d0e req-3e973749-1042-4f10-84de-18dbcd58c365 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080311 Oct 14 13:00:37.944187 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 52/112] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:00:38.469996 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5de111c2-15e0-4b28-b356-322dcd6ec536 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:38.470876 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5de111c2-15e0-4b28-b356-322dcd6ec536 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:38.478018 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5de111c2-15e0-4b28-b356-322dcd6ec536 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:38.479403 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5de111c2-15e0-4b28-b356-322dcd6ec536 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:38.480081 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5de111c2-15e0-4b28-b356-322dcd6ec536 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:38.481889 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5de111c2-15e0-4b28-b356-322dcd6ec536 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:38.482476 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5de111c2-15e0-4b28-b356-322dcd6ec536 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:38.482977 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5de111c2-15e0-4b28-b356-322dcd6ec536 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:38.672897 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5de111c2-15e0-4b28-b356-322dcd6ec536 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:38.682255 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5de111c2-15e0-4b28-b356-322dcd6ec536 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.216033 Oct 14 13:00:38.682975 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 61/113] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:38 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:38.896321 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e93f6736-cd78-45af-843b-db14889bf0c3 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:38.897014 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e93f6736-cd78-45af-843b-db14889bf0c3 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:38.903293 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e93f6736-cd78-45af-843b-db14889bf0c3 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:38.903768 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e93f6736-cd78-45af-843b-db14889bf0c3 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:38.904195 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e93f6736-cd78-45af-843b-db14889bf0c3 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:38.904874 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e93f6736-cd78-45af-843b-db14889bf0c3 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:38.905318 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e93f6736-cd78-45af-843b-db14889bf0c3 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:38.905761 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e93f6736-cd78-45af-843b-db14889bf0c3 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:38.939407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e93f6736-cd78-45af-843b-db14889bf0c3 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:38.939885 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e93f6736-cd78-45af-843b-db14889bf0c3 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:38.940310 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e93f6736-cd78-45af-843b-db14889bf0c3 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:38.940748 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-e93f6736-cd78-45af-843b-db14889bf0c3 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lazy-loading 'fault' on Instance uuid 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:00:39.013835 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e93f6736-cd78-45af-843b-db14889bf0c3 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a23786597854812a0931f8622ce38c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '758ac8ee488d498882fce45dc7255676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:39.022673 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e93f6736-cd78-45af-843b-db14889bf0c3 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 200 len: 1351 microversion: 2.1 time: 0.130937 Oct 14 13:00:39.023340 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 53/114] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:38 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 1351 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:39.706383 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0e1d8aa2-bb3a-4052-9312-8f929fe168d8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:39.708741 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0e1d8aa2-bb3a-4052-9312-8f929fe168d8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:39.718600 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e1d8aa2-bb3a-4052-9312-8f929fe168d8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:39.719381 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e1d8aa2-bb3a-4052-9312-8f929fe168d8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:39.720019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e1d8aa2-bb3a-4052-9312-8f929fe168d8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:39.721133 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e1d8aa2-bb3a-4052-9312-8f929fe168d8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:39.721868 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e1d8aa2-bb3a-4052-9312-8f929fe168d8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:39.722490 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e1d8aa2-bb3a-4052-9312-8f929fe168d8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:39.920976 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0e1d8aa2-bb3a-4052-9312-8f929fe168d8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:39.928963 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0e1d8aa2-bb3a-4052-9312-8f929fe168d8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.226389 Oct 14 13:00:39.929556 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 62/115] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:39 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:40.045599 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e00aa88b-cf43-4756-9a3f-952e5a7c40b8 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:40.046260 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e00aa88b-cf43-4756-9a3f-952e5a7c40b8 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:40.052970 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e00aa88b-cf43-4756-9a3f-952e5a7c40b8 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:40.053461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e00aa88b-cf43-4756-9a3f-952e5a7c40b8 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:40.053920 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e00aa88b-cf43-4756-9a3f-952e5a7c40b8 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:40.054612 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e00aa88b-cf43-4756-9a3f-952e5a7c40b8 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:40.055373 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e00aa88b-cf43-4756-9a3f-952e5a7c40b8 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:40.055952 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e00aa88b-cf43-4756-9a3f-952e5a7c40b8 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:40.071612 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-e00aa88b-cf43-4756-9a3f-952e5a7c40b8 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] HTTP exception thrown: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e00aa88b-cf43-4756-9a3f-952e5a7c40b8 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Request method failure captured: Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b HTTP/1.1 Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1GggO_pQ3-44b4LIGddF-Ro5PbMiUS9BYdUL6ZSYQhQ8ujyxoEnXiglxeNQV38eS0jBlki4qXKo-EL0kZlFjZvs-6NhLYuXLCfv3IqDKHSZxK4aKl1X3hQc4yc8yvy53ayESN82k_UlCvVxKpP9WK9byMqSOKu2I7EN-CYaAmWzQk Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 758ac8ee488d498882fce45dc7255676 Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-DeleteServersTestJSON-1283773991 Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:00:40.076736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:00:40.078209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/758ac8ee488d498882fce45dc7255676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/758ac8ee488d498882fce45dc7255676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/758ac8ee488d498882fce45dc7255676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_758ac8ee488d498882fce45dc7255676", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:00:40.078209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-DeleteServersTestJSON-1283773991 Oct 14 13:00:40.078209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 758ac8ee488d498882fce45dc7255676 Oct 14 13:00:40.078209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-DeleteServersTestJSON-1283773991 Oct 14 13:00:40.078209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-DeleteServersTestJSON-1283773991-project Oct 14 13:00:40.078209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:00:40.078209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:00:40.078209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 4a23786597854812a0931f8622ce38c7 Oct 14 13:00:40.078209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-DeleteServersTestJSON-1283773991-project Oct 14 13:00:40.078209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:00:40.078209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:40.078209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b'} Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:00:40.079013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:40.080280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:00:40.081446 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e00aa88b-cf43-4756-9a3f-952e5a7c40b8 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Returning 404 to user: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:00:40.081446 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e00aa88b-cf43-4756-9a3f-952e5a7c40b8 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 404 len: 111 microversion: 2.1 time: 0.037100 Oct 14 13:00:40.081446 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 54/116] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:40 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:00:40.233958 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-79645f9a-c1b5-40b3-b355-3cdbaa0504a6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:40.236652 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-79645f9a-c1b5-40b3-b355-3cdbaa0504a6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:40.245216 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-79645f9a-c1b5-40b3-b355-3cdbaa0504a6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:40.245945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-79645f9a-c1b5-40b3-b355-3cdbaa0504a6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:40.246530 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-79645f9a-c1b5-40b3-b355-3cdbaa0504a6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:40.247406 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-79645f9a-c1b5-40b3-b355-3cdbaa0504a6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:40.248402 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-79645f9a-c1b5-40b3-b355-3cdbaa0504a6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:40.248976 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-79645f9a-c1b5-40b3-b355-3cdbaa0504a6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:40.270408 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-79645f9a-c1b5-40b3-b355-3cdbaa0504a6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] HTTP exception thrown: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-79645f9a-c1b5-40b3-b355-3cdbaa0504a6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Request method failure captured: Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b/os-volume_attachments HTTP/1.1 Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV1GggO_pQ3-44b4LIGddF-Ro5PbMiUS9BYdUL6ZSYQhQ8ujyxoEnXiglxeNQV38eS0jBlki4qXKo-EL0kZlFjZvs-6NhLYuXLCfv3IqDKHSZxK4aKl1X3hQc4yc8yvy53ayESN82k_UlCvVxKpP9WK9byMqSOKu2I7EN-CYaAmWzQk Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 758ac8ee488d498882fce45dc7255676 Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-DeleteServersTestJSON-1283773991 Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:00:40.278632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:00:40.280109 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/758ac8ee488d498882fce45dc7255676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/758ac8ee488d498882fce45dc7255676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/758ac8ee488d498882fce45dc7255676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_758ac8ee488d498882fce45dc7255676", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:00:40.280109 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-DeleteServersTestJSON-1283773991 Oct 14 13:00:40.280109 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 758ac8ee488d498882fce45dc7255676 Oct 14 13:00:40.280109 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-DeleteServersTestJSON-1283773991 Oct 14 13:00:40.280109 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-DeleteServersTestJSON-1283773991-project Oct 14 13:00:40.280109 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:00:40.280109 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:00:40.280109 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 4a23786597854812a0931f8622ce38c7 Oct 14 13:00:40.280109 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-DeleteServersTestJSON-1283773991-project Oct 14 13:00:40.280109 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:00:40.280109 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:40.280109 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'server_id': '3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b'} Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:00:40.280894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:40.282242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:00:40.284750 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-79645f9a-c1b5-40b3-b355-3cdbaa0504a6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Returning 404 to user: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:00:40.286259 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-79645f9a-c1b5-40b3-b355-3cdbaa0504a6 tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059515 Oct 14 13:00:40.287765 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 63/117] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:00:40 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b/os-volume_attachments => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 13:00:40.952169 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a9618c94-29ee-4ef9-bb61-611dd46323c3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:40.952790 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-a9618c94-29ee-4ef9-bb61-611dd46323c3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:40.960544 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a9618c94-29ee-4ef9-bb61-611dd46323c3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:40.964595 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a9618c94-29ee-4ef9-bb61-611dd46323c3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:40.965319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a9618c94-29ee-4ef9-bb61-611dd46323c3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:40.966145 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a9618c94-29ee-4ef9-bb61-611dd46323c3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:40.967973 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a9618c94-29ee-4ef9-bb61-611dd46323c3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:40.968609 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a9618c94-29ee-4ef9-bb61-611dd46323c3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:41.155782 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a9618c94-29ee-4ef9-bb61-611dd46323c3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:41.165385 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-a9618c94-29ee-4ef9-bb61-611dd46323c3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.216777 Oct 14 13:00:41.166183 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 55/118] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:40 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:41.647298 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0723db0a-690d-444a-9970-f9d3af187d6e tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:41.647827 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0723db0a-690d-444a-9970-f9d3af187d6e tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:41.659982 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0723db0a-690d-444a-9970-f9d3af187d6e tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:41.660663 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0723db0a-690d-444a-9970-f9d3af187d6e tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:41.660945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0723db0a-690d-444a-9970-f9d3af187d6e tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:41.661687 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0723db0a-690d-444a-9970-f9d3af187d6e tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:41.664447 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0723db0a-690d-444a-9970-f9d3af187d6e tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:41.667295 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0723db0a-690d-444a-9970-f9d3af187d6e tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:41.686510 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-0723db0a-690d-444a-9970-f9d3af187d6e tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] HTTP exception thrown: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0723db0a-690d-444a-9970-f9d3af187d6e tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Request method failure captured: Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: DELETE /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b HTTP/1.1 Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV1GggO_pQ3-44b4LIGddF-Ro5PbMiUS9BYdUL6ZSYQhQ8ujyxoEnXiglxeNQV38eS0jBlki4qXKo-EL0kZlFjZvs-6NhLYuXLCfv3IqDKHSZxK4aKl1X3hQc4yc8yvy53ayESN82k_UlCvVxKpP9WK9byMqSOKu2I7EN-CYaAmWzQk Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 758ac8ee488d498882fce45dc7255676 Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-DeleteServersTestJSON-1283773991 Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:00:41.689121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:00:41.690591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/758ac8ee488d498882fce45dc7255676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/758ac8ee488d498882fce45dc7255676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/758ac8ee488d498882fce45dc7255676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_758ac8ee488d498882fce45dc7255676", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:00:41.690591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-DeleteServersTestJSON-1283773991 Oct 14 13:00:41.690591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 758ac8ee488d498882fce45dc7255676 Oct 14 13:00:41.690591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-DeleteServersTestJSON-1283773991 Oct 14 13:00:41.690591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-DeleteServersTestJSON-1283773991-project Oct 14 13:00:41.690591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:00:41.690591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:00:41.690591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 4a23786597854812a0931f8622ce38c7 Oct 14 13:00:41.690591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-DeleteServersTestJSON-1283773991-project Oct 14 13:00:41.690591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:00:41.690591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:41.690591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b'} Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:00:41.691276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:41.692361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:00:41.695102 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0723db0a-690d-444a-9970-f9d3af187d6e tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Returning 404 to user: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:00:41.696866 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0723db0a-690d-444a-9970-f9d3af187d6e tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 404 len: 111 microversion: 2.1 time: 0.053697 Oct 14 13:00:41.698563 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 64/119] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:00:41 2022] DELETE /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:00:41.710575 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5088af58-1511-4312-a05c-9381538e4e6f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:41.711489 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5088af58-1511-4312-a05c-9381538e4e6f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] [instance: 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:41.722478 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5088af58-1511-4312-a05c-9381538e4e6f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:41.723587 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5088af58-1511-4312-a05c-9381538e4e6f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:41.724134 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5088af58-1511-4312-a05c-9381538e4e6f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:41.725369 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5088af58-1511-4312-a05c-9381538e4e6f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:41.726236 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5088af58-1511-4312-a05c-9381538e4e6f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:41.727367 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5088af58-1511-4312-a05c-9381538e4e6f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:41.746247 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-5088af58-1511-4312-a05c-9381538e4e6f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] HTTP exception thrown: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5088af58-1511-4312-a05c-9381538e4e6f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Request method failure captured: Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b HTTP/1.1 Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1GggO_pQ3-44b4LIGddF-Ro5PbMiUS9BYdUL6ZSYQhQ8ujyxoEnXiglxeNQV38eS0jBlki4qXKo-EL0kZlFjZvs-6NhLYuXLCfv3IqDKHSZxK4aKl1X3hQc4yc8yvy53ayESN82k_UlCvVxKpP9WK9byMqSOKu2I7EN-CYaAmWzQk Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 758ac8ee488d498882fce45dc7255676 Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-DeleteServersTestJSON-1283773991 Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:00:41.749436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:00:41.751166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/758ac8ee488d498882fce45dc7255676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/758ac8ee488d498882fce45dc7255676"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/758ac8ee488d498882fce45dc7255676"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_758ac8ee488d498882fce45dc7255676", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:00:41.751166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-DeleteServersTestJSON-1283773991 Oct 14 13:00:41.751166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 758ac8ee488d498882fce45dc7255676 Oct 14 13:00:41.751166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-DeleteServersTestJSON-1283773991 Oct 14 13:00:41.751166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-DeleteServersTestJSON-1283773991-project Oct 14 13:00:41.751166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:00:41.751166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:00:41.751166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 4a23786597854812a0931f8622ce38c7 Oct 14 13:00:41.751166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-DeleteServersTestJSON-1283773991-project Oct 14 13:00:41.751166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:00:41.751166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:41.751166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b'} Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:00:41.751855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. Oct 14 13:00:41.752893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:00:41.754456 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5088af58-1511-4312-a05c-9381538e4e6f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] Returning 404 to user: Instance 3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:00:41.757298 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5088af58-1511-4312-a05c-9381538e4e6f tempest-DeleteServersTestJSON-1283773991 tempest-DeleteServersTestJSON-1283773991-project] 10.222.0.47 "GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b" status: 404 len: 111 microversion: 2.1 time: 0.053179 Oct 14 13:00:41.763094 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 56/120] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:41 2022] GET /compute/v2.1/servers/3537c3d2-fcc8-4b28-b92e-d9d913ee8c3b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:00:42.188531 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4eadd3e3-e913-473e-b9e6-9476be5b7531 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:42.189140 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-4eadd3e3-e913-473e-b9e6-9476be5b7531 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:42.200253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4eadd3e3-e913-473e-b9e6-9476be5b7531 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:42.200253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4eadd3e3-e913-473e-b9e6-9476be5b7531 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:42.200253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4eadd3e3-e913-473e-b9e6-9476be5b7531 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:42.203245 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4eadd3e3-e913-473e-b9e6-9476be5b7531 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:42.203713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4eadd3e3-e913-473e-b9e6-9476be5b7531 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:42.204308 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4eadd3e3-e913-473e-b9e6-9476be5b7531 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:42.209008 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:42.424840 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-4eadd3e3-e913-473e-b9e6-9476be5b7531 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:42.433170 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4eadd3e3-e913-473e-b9e6-9476be5b7531 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.248488 Oct 14 13:00:42.449665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 65/121] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:42 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:43.456805 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cdefd6fb-0443-4b9c-b85c-cd83fd19f009 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:43.457612 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-cdefd6fb-0443-4b9c-b85c-cd83fd19f009 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:43.469369 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cdefd6fb-0443-4b9c-b85c-cd83fd19f009 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:43.469902 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cdefd6fb-0443-4b9c-b85c-cd83fd19f009 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:43.473076 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cdefd6fb-0443-4b9c-b85c-cd83fd19f009 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:43.473873 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cdefd6fb-0443-4b9c-b85c-cd83fd19f009 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:43.474341 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cdefd6fb-0443-4b9c-b85c-cd83fd19f009 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:43.474773 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cdefd6fb-0443-4b9c-b85c-cd83fd19f009 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:43.739799 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-cdefd6fb-0443-4b9c-b85c-cd83fd19f009 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:43.749617 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-cdefd6fb-0443-4b9c-b85c-cd83fd19f009 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.297201 Oct 14 13:00:43.753931 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 57/122] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:43 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:44.780030 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-8a2204af-9fa0-4a72-91ec-87dac5879dc2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:44.780677 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-8a2204af-9fa0-4a72-91ec-87dac5879dc2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:44.787982 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=75 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:44.800595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8a2204af-9fa0-4a72-91ec-87dac5879dc2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:44.804279 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8a2204af-9fa0-4a72-91ec-87dac5879dc2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:44.804754 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8a2204af-9fa0-4a72-91ec-87dac5879dc2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:44.808476 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8a2204af-9fa0-4a72-91ec-87dac5879dc2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:44.809450 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8a2204af-9fa0-4a72-91ec-87dac5879dc2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:44.811822 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8a2204af-9fa0-4a72-91ec-87dac5879dc2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:45.194518 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-8a2204af-9fa0-4a72-91ec-87dac5879dc2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:45.208585 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-8a2204af-9fa0-4a72-91ec-87dac5879dc2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.432170 Oct 14 13:00:45.209193 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 66/123] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:44 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:46.242399 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-db2adf88-ab6e-4df7-82a6-39716df7693f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:46.248771 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-db2adf88-ab6e-4df7-82a6-39716df7693f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:46.255644 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db2adf88-ab6e-4df7-82a6-39716df7693f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:46.256382 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db2adf88-ab6e-4df7-82a6-39716df7693f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:46.256997 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db2adf88-ab6e-4df7-82a6-39716df7693f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:46.257909 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db2adf88-ab6e-4df7-82a6-39716df7693f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:46.258497 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db2adf88-ab6e-4df7-82a6-39716df7693f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:46.259070 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db2adf88-ab6e-4df7-82a6-39716df7693f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:46.631986 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-db2adf88-ab6e-4df7-82a6-39716df7693f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:46.654182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-db2adf88-ab6e-4df7-82a6-39716df7693f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.423462 Oct 14 13:00:46.654957 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 58/124] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:46 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:47.678709 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-3abf52f3-97ad-4f94-b49b-b1e60af75bfe tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:47.679316 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-3abf52f3-97ad-4f94-b49b-b1e60af75bfe tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:47.694637 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3abf52f3-97ad-4f94-b49b-b1e60af75bfe tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:47.695563 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3abf52f3-97ad-4f94-b49b-b1e60af75bfe tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:47.696075 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3abf52f3-97ad-4f94-b49b-b1e60af75bfe tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:47.696896 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3abf52f3-97ad-4f94-b49b-b1e60af75bfe tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:47.697456 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3abf52f3-97ad-4f94-b49b-b1e60af75bfe tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:47.698855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3abf52f3-97ad-4f94-b49b-b1e60af75bfe tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:47.994044 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3abf52f3-97ad-4f94-b49b-b1e60af75bfe tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:48.003930 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-3abf52f3-97ad-4f94-b49b-b1e60af75bfe tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.328961 Oct 14 13:00:48.004692 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 67/125] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:47 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:49.027749 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-008c26bf-f678-4eff-b9ad-46e9ecfde9b1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:49.029019 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-008c26bf-f678-4eff-b9ad-46e9ecfde9b1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:49.037310 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-008c26bf-f678-4eff-b9ad-46e9ecfde9b1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:49.038196 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-008c26bf-f678-4eff-b9ad-46e9ecfde9b1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:49.038750 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-008c26bf-f678-4eff-b9ad-46e9ecfde9b1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:49.039821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-008c26bf-f678-4eff-b9ad-46e9ecfde9b1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:49.040352 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-008c26bf-f678-4eff-b9ad-46e9ecfde9b1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:49.041451 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-008c26bf-f678-4eff-b9ad-46e9ecfde9b1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:49.243792 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-008c26bf-f678-4eff-b9ad-46e9ecfde9b1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:49.255022 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-008c26bf-f678-4eff-b9ad-46e9ecfde9b1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.230967 Oct 14 13:00:49.263521 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 59/126] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:49 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:50.284006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-3dcb5b88-10be-4ae4-9093-d305798b6926 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:50.284607 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-3dcb5b88-10be-4ae4-9093-d305798b6926 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:50.291790 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3dcb5b88-10be-4ae4-9093-d305798b6926 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:50.292472 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3dcb5b88-10be-4ae4-9093-d305798b6926 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:50.293090 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3dcb5b88-10be-4ae4-9093-d305798b6926 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:50.293973 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3dcb5b88-10be-4ae4-9093-d305798b6926 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:50.294575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3dcb5b88-10be-4ae4-9093-d305798b6926 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:50.295147 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3dcb5b88-10be-4ae4-9093-d305798b6926 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:50.733898 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3dcb5b88-10be-4ae4-9093-d305798b6926 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:50.744599 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-3dcb5b88-10be-4ae4-9093-d305798b6926 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.464203 Oct 14 13:00:50.745686 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 68/127] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:50 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:51.770546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-1167bbd8-cbf0-4186-8baa-9b89575489e6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:51.771222 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-1167bbd8-cbf0-4186-8baa-9b89575489e6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:51.784853 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:51.794868 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1167bbd8-cbf0-4186-8baa-9b89575489e6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:51.795610 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1167bbd8-cbf0-4186-8baa-9b89575489e6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:51.797638 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1167bbd8-cbf0-4186-8baa-9b89575489e6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:51.803316 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1167bbd8-cbf0-4186-8baa-9b89575489e6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:51.803800 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1167bbd8-cbf0-4186-8baa-9b89575489e6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:51.805797 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1167bbd8-cbf0-4186-8baa-9b89575489e6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:52.094243 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-1167bbd8-cbf0-4186-8baa-9b89575489e6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:52.103911 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-1167bbd8-cbf0-4186-8baa-9b89575489e6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.340151 Oct 14 13:00:52.121889 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 60/128] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:51 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:53.135625 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e1606bf6-5a9e-4258-a45e-2133479919b5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:53.137286 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e1606bf6-5a9e-4258-a45e-2133479919b5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:53.145153 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e1606bf6-5a9e-4258-a45e-2133479919b5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:53.145994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e1606bf6-5a9e-4258-a45e-2133479919b5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:53.146643 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e1606bf6-5a9e-4258-a45e-2133479919b5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:53.147708 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e1606bf6-5a9e-4258-a45e-2133479919b5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:53.148784 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e1606bf6-5a9e-4258-a45e-2133479919b5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:53.149438 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e1606bf6-5a9e-4258-a45e-2133479919b5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:53.417267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e1606bf6-5a9e-4258-a45e-2133479919b5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:53.457278 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e1606bf6-5a9e-4258-a45e-2133479919b5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.326791 Oct 14 13:00:53.458467 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 69/129] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:53 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:54.480768 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-429c7c85-420a-41aa-8aeb-dad8903bab74 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:54.481513 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-429c7c85-420a-41aa-8aeb-dad8903bab74 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:54.489658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-429c7c85-420a-41aa-8aeb-dad8903bab74 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:54.490425 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-429c7c85-420a-41aa-8aeb-dad8903bab74 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:54.491046 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-429c7c85-420a-41aa-8aeb-dad8903bab74 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:54.491941 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-429c7c85-420a-41aa-8aeb-dad8903bab74 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:54.492557 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-429c7c85-420a-41aa-8aeb-dad8903bab74 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:54.493153 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-429c7c85-420a-41aa-8aeb-dad8903bab74 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:54.682978 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-429c7c85-420a-41aa-8aeb-dad8903bab74 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:54.689403 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:00:54.691857 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-429c7c85-420a-41aa-8aeb-dad8903bab74 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.215529 Oct 14 13:00:54.692938 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 61/130] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:54 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:55.041647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6d2dd8db-61dc-4260-a6a3-8af3d9c04c7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Action: 'create', calling method: .version_select at 0x7fbb81ee4d30>, body: {"keypair": {"name": "tempest-keypair-580466469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTH6v0MUDd/5fmPDkTLieCGfm+uU0fvkiFfDToPsPazqkMXTYBgJjwjwM/XNOGSRu0d9hkaDEgyKH2mLN+x/nxKvU6RakdFXlhuhjcDORvdC+7kprAH3h5uIgNP+JPr2w=="}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:55.089631 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-6d2dd8db-61dc-4260-a6a3-8af3d9c04c7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Getting quotas for project 5d716a28995942e788205c1ad1e83bb3. Resources: {'key_pairs'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:00:55.093609 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-6d2dd8db-61dc-4260-a6a3-8af3d9c04c7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Getting quotas for user 26a54235fb424dfd825b2de9f7aaa006 and project 5d716a28995942e788205c1ad1e83bb3. Resources: {'key_pairs'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:00:55.139936 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-6d2dd8db-61dc-4260-a6a3-8af3d9c04c7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.257028 Oct 14 13:00:55.140560 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 70/131] 10.222.0.47 () {62 vars in 1200 bytes} [Fri Oct 14 13:00:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 258 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 14 13:00:55.728947 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8b6b4ba2-bec9-4381-af7a-9c375060b653 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:55.737588 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8b6b4ba2-bec9-4381-af7a-9c375060b653 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:55.749319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8b6b4ba2-bec9-4381-af7a-9c375060b653 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:55.749944 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8b6b4ba2-bec9-4381-af7a-9c375060b653 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:55.753539 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8b6b4ba2-bec9-4381-af7a-9c375060b653 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:55.754928 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8b6b4ba2-bec9-4381-af7a-9c375060b653 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:55.755635 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8b6b4ba2-bec9-4381-af7a-9c375060b653 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:55.756433 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8b6b4ba2-bec9-4381-af7a-9c375060b653 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:56.179263 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8b6b4ba2-bec9-4381-af7a-9c375060b653 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:56.188863 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8b6b4ba2-bec9-4381-af7a-9c375060b653 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.470313 Oct 14 13:00:56.192337 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 62/132] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:55 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:56.881943 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-353267424", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d80192b0-2cb7-4b32-acc8-b8489f9d8a8b"}], "security_groups": [{"name": "tempest-securitygroup--1810931329"}], "key_name": "tempest-keypair-580466469", "user_data": "}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:00:57.218091 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e719e177-a6b8-4b56-b020-b95305431e5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:57.218924 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e719e177-a6b8-4b56-b020-b95305431e5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:57.225656 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e719e177-a6b8-4b56-b020-b95305431e5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:57.226323 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e719e177-a6b8-4b56-b020-b95305431e5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:57.228967 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e719e177-a6b8-4b56-b020-b95305431e5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:57.230025 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e719e177-a6b8-4b56-b020-b95305431e5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:57.230675 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e719e177-a6b8-4b56-b020-b95305431e5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:57.231286 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e719e177-a6b8-4b56-b020-b95305431e5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:57.240335 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.network.neutron [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] validate_networks() for [('d80192b0-2cb7-4b32-acc8-b8489f9d8a8b', None, None, None, None, None)] {{(pid=118868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:00:57.376142 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e719e177-a6b8-4b56-b020-b95305431e5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:57.384299 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e719e177-a6b8-4b56-b020-b95305431e5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.169971 Oct 14 13:00:57.384984 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 63/133] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:57 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:00:57.671066 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Flavor limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:00:57.671648 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Image limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:00:57.672172 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Flavor pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:00:57.672978 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Image pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:00:57.673646 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:00:57.683992 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:57.684561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:57.684989 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:57.685749 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:57.686195 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:57.686610 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:57.711339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Getting quotas for project 5d716a28995942e788205c1ad1e83bb3. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:00:57.719138 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Getting quotas for user 26a54235fb424dfd825b2de9f7aaa006 and project 5d716a28995942e788205c1ad1e83bb3. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:00:57.755479 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Going to run 1 instances... {{(pid=118868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:00:57.761716 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:00:57.861212 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c83784eb-534b-4b9e-b54d-87e175f3bf99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.984168 Oct 14 13:00:57.862214 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 71/134] 10.222.0.47 () {62 vars in 1188 bytes} [Fri Oct 14 13:00:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 14 13:00:57.873857 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-685f9cde-f395-43cf-9b52-e36df77cd9dc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:57.874615 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-685f9cde-f395-43cf-9b52-e36df77cd9dc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:57.975275 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-685f9cde-f395-43cf-9b52-e36df77cd9dc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:57.985233 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-685f9cde-f395-43cf-9b52-e36df77cd9dc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:57.986612 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-685f9cde-f395-43cf-9b52-e36df77cd9dc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:57.987745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-685f9cde-f395-43cf-9b52-e36df77cd9dc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1280 microversion: 2.20 time: 0.118047 Oct 14 13:00:57.988297 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 64/135] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:00:57 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1280 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:00:58.409314 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7244752d-b13f-4c23-8d60-d0fc3be51bab tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:58.410048 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-7244752d-b13f-4c23-8d60-d0fc3be51bab tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:58.417653 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7244752d-b13f-4c23-8d60-d0fc3be51bab tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:58.418141 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7244752d-b13f-4c23-8d60-d0fc3be51bab tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:58.418675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7244752d-b13f-4c23-8d60-d0fc3be51bab tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:58.419420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7244752d-b13f-4c23-8d60-d0fc3be51bab tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:58.420068 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7244752d-b13f-4c23-8d60-d0fc3be51bab tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:58.420492 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7244752d-b13f-4c23-8d60-d0fc3be51bab tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:58.563835 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-7244752d-b13f-4c23-8d60-d0fc3be51bab tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:58.572249 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7244752d-b13f-4c23-8d60-d0fc3be51bab tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.167156 Oct 14 13:00:58.572832 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 72/136] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:58 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:00:59.014768 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e80a3d5c-2424-48bc-b12a-2afef8b0a271 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:59.016008 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e80a3d5c-2424-48bc-b12a-2afef8b0a271 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:59.022155 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e80a3d5c-2424-48bc-b12a-2afef8b0a271 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:59.022736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e80a3d5c-2424-48bc-b12a-2afef8b0a271 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:59.023258 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e80a3d5c-2424-48bc-b12a-2afef8b0a271 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:59.024032 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e80a3d5c-2424-48bc-b12a-2afef8b0a271 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:59.025115 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e80a3d5c-2424-48bc-b12a-2afef8b0a271 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:59.025642 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e80a3d5c-2424-48bc-b12a-2afef8b0a271 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:59.093107 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e80a3d5c-2424-48bc-b12a-2afef8b0a271 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:59.112161 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e80a3d5c-2424-48bc-b12a-2afef8b0a271 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:59.113863 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e80a3d5c-2424-48bc-b12a-2afef8b0a271 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:59.115392 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e80a3d5c-2424-48bc-b12a-2afef8b0a271 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1284 microversion: 2.20 time: 0.104396 Oct 14 13:00:59.115865 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 65/137] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:00:59 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:00:59.595552 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4fcda50c-965d-46bd-a430-24330645c10a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:00:59.596158 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-4fcda50c-965d-46bd-a430-24330645c10a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:00:59.602631 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4fcda50c-965d-46bd-a430-24330645c10a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:59.603094 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4fcda50c-965d-46bd-a430-24330645c10a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:59.603521 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4fcda50c-965d-46bd-a430-24330645c10a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:59.604197 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4fcda50c-965d-46bd-a430-24330645c10a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:00:59.604644 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4fcda50c-965d-46bd-a430-24330645c10a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:00:59.605057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4fcda50c-965d-46bd-a430-24330645c10a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:00:59.751620 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-4fcda50c-965d-46bd-a430-24330645c10a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:00:59.763101 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4fcda50c-965d-46bd-a430-24330645c10a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.171342 Oct 14 13:00:59.763672 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 73/138] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:00:59 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:00.140686 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-81181a17-eb27-456f-8751-3bdd7a31c692 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:00.141310 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-81181a17-eb27-456f-8751-3bdd7a31c692 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:00.147412 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-81181a17-eb27-456f-8751-3bdd7a31c692 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:00.147891 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-81181a17-eb27-456f-8751-3bdd7a31c692 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:00.148324 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-81181a17-eb27-456f-8751-3bdd7a31c692 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:00.149003 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-81181a17-eb27-456f-8751-3bdd7a31c692 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:00.149449 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-81181a17-eb27-456f-8751-3bdd7a31c692 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:00.149900 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-81181a17-eb27-456f-8751-3bdd7a31c692 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:00.212267 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-81181a17-eb27-456f-8751-3bdd7a31c692 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:00.220776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-81181a17-eb27-456f-8751-3bdd7a31c692 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:00.222272 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-81181a17-eb27-456f-8751-3bdd7a31c692 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:00.223411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-81181a17-eb27-456f-8751-3bdd7a31c692 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1332 microversion: 2.20 time: 0.087019 Oct 14 13:01:00.223960 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 66/139] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:01:00 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:01:00.787753 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2f26747b-3ecf-470e-897f-41aa03d66fb0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:00.788372 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2f26747b-3ecf-470e-897f-41aa03d66fb0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:00.795260 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f26747b-3ecf-470e-897f-41aa03d66fb0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:00.795776 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f26747b-3ecf-470e-897f-41aa03d66fb0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:00.796213 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f26747b-3ecf-470e-897f-41aa03d66fb0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:00.796895 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f26747b-3ecf-470e-897f-41aa03d66fb0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:00.797344 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f26747b-3ecf-470e-897f-41aa03d66fb0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:00.798248 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f26747b-3ecf-470e-897f-41aa03d66fb0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:00.928619 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2f26747b-3ecf-470e-897f-41aa03d66fb0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:00.936940 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2f26747b-3ecf-470e-897f-41aa03d66fb0 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1520 microversion: 2.1 time: 0.153145 Oct 14 13:01:00.937514 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 74/140] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:00 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:01.248867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4cf3c8f4-8718-4ad7-8d1e-86bfbc517ea5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:01.249585 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4cf3c8f4-8718-4ad7-8d1e-86bfbc517ea5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:01.257601 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cf3c8f4-8718-4ad7-8d1e-86bfbc517ea5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:01.258086 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cf3c8f4-8718-4ad7-8d1e-86bfbc517ea5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:01.258523 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cf3c8f4-8718-4ad7-8d1e-86bfbc517ea5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:01.260119 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cf3c8f4-8718-4ad7-8d1e-86bfbc517ea5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:01.260673 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cf3c8f4-8718-4ad7-8d1e-86bfbc517ea5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:01.261102 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cf3c8f4-8718-4ad7-8d1e-86bfbc517ea5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:01.343562 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4cf3c8f4-8718-4ad7-8d1e-86bfbc517ea5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:01.366917 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4cf3c8f4-8718-4ad7-8d1e-86bfbc517ea5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:01.368916 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4cf3c8f4-8718-4ad7-8d1e-86bfbc517ea5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:01.370090 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4cf3c8f4-8718-4ad7-8d1e-86bfbc517ea5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1340 microversion: 2.20 time: 0.125310 Oct 14 13:01:01.370644 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 67/141] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:01:01 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1340 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:01:01.963816 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5dec3b35-796c-4b20-8bde-98221aaaddcf tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:01.964535 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5dec3b35-796c-4b20-8bde-98221aaaddcf tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:01.976990 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5dec3b35-796c-4b20-8bde-98221aaaddcf tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:01.977947 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5dec3b35-796c-4b20-8bde-98221aaaddcf tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:01.978383 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5dec3b35-796c-4b20-8bde-98221aaaddcf tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:01.979088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5dec3b35-796c-4b20-8bde-98221aaaddcf tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:01.979534 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5dec3b35-796c-4b20-8bde-98221aaaddcf tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:01.979948 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5dec3b35-796c-4b20-8bde-98221aaaddcf tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:02.239294 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5dec3b35-796c-4b20-8bde-98221aaaddcf tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:02.247232 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5dec3b35-796c-4b20-8bde-98221aaaddcf tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1500 microversion: 2.1 time: 0.291294 Oct 14 13:01:02.247809 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 75/142] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:01 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1500 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:02.269941 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c1cd36e8-4e2a-426c-8b76-fa30633e706a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:02.270559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c1cd36e8-4e2a-426c-8b76-fa30633e706a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:02.279105 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c1cd36e8-4e2a-426c-8b76-fa30633e706a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:02.279873 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c1cd36e8-4e2a-426c-8b76-fa30633e706a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:02.280336 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c1cd36e8-4e2a-426c-8b76-fa30633e706a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:02.281147 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c1cd36e8-4e2a-426c-8b76-fa30633e706a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:02.281636 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c1cd36e8-4e2a-426c-8b76-fa30633e706a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:02.282062 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c1cd36e8-4e2a-426c-8b76-fa30633e706a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:02.395705 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0654f362-5810-4b50-95a9-909498fe5a56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:02.396731 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0654f362-5810-4b50-95a9-909498fe5a56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:02.404246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0654f362-5810-4b50-95a9-909498fe5a56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:02.404786 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0654f362-5810-4b50-95a9-909498fe5a56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:02.405513 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0654f362-5810-4b50-95a9-909498fe5a56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:02.406350 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0654f362-5810-4b50-95a9-909498fe5a56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:02.406974 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0654f362-5810-4b50-95a9-909498fe5a56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:02.407534 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0654f362-5810-4b50-95a9-909498fe5a56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:02.430613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c1cd36e8-4e2a-426c-8b76-fa30633e706a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:02.440030 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c1cd36e8-4e2a-426c-8b76-fa30633e706a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1515 microversion: 2.1 time: 0.173852 Oct 14 13:01:02.441128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 68/143] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:02 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:02.632131 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0654f362-5810-4b50-95a9-909498fe5a56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:02.641227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0654f362-5810-4b50-95a9-909498fe5a56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:02.642664 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0654f362-5810-4b50-95a9-909498fe5a56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:02.643948 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0654f362-5810-4b50-95a9-909498fe5a56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1406 microversion: 2.20 time: 0.252829 Oct 14 13:01:02.644776 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 76/144] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:01:02 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:01:02.963748 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-4320f16e-42c8-4628-869a-fc3ec49c58b5 req-aebc1c4e-18e0-4cef-8414-6803b425dc8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8f2bb08-a11d-46c6-96f5-9a9f85316fd0", "tag": "e3f9c588-4549-470d-90da-07db69916332"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:02.974575 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-4320f16e-42c8-4628-869a-fc3ec49c58b5 req-aebc1c4e-18e0-4cef-8414-6803b425dc8f service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:02.975562 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-4320f16e-42c8-4628-869a-fc3ec49c58b5 req-aebc1c4e-18e0-4cef-8414-6803b425dc8f service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:02.976202 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-4320f16e-42c8-4628-869a-fc3ec49c58b5 req-aebc1c4e-18e0-4cef-8414-6803b425dc8f service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:02.994411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-4320f16e-42c8-4628-869a-fc3ec49c58b5 req-aebc1c4e-18e0-4cef-8414-6803b425dc8f service nova] Creating event network-changed:e3f9c588-4549-470d-90da-07db69916332 for instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 on hv-cinder-82099 Oct 14 13:01:03.000624 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-4320f16e-42c8-4628-869a-fc3ec49c58b5 req-aebc1c4e-18e0-4cef-8414-6803b425dc8f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043155 Oct 14 13:01:03.001646 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 69/145] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:01:03.670587 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6cd1a536-8178-4503-a0a8-0915812356a5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:03.671338 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-6cd1a536-8178-4503-a0a8-0915812356a5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:03.678336 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6cd1a536-8178-4503-a0a8-0915812356a5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:03.678821 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6cd1a536-8178-4503-a0a8-0915812356a5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:03.679259 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6cd1a536-8178-4503-a0a8-0915812356a5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:03.679940 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6cd1a536-8178-4503-a0a8-0915812356a5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:03.680387 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6cd1a536-8178-4503-a0a8-0915812356a5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:03.680857 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6cd1a536-8178-4503-a0a8-0915812356a5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:03.815279 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-6cd1a536-8178-4503-a0a8-0915812356a5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:03.824838 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-6cd1a536-8178-4503-a0a8-0915812356a5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:03.826313 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-6cd1a536-8178-4503-a0a8-0915812356a5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:03.827413 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-6cd1a536-8178-4503-a0a8-0915812356a5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1406 microversion: 2.20 time: 0.160975 Oct 14 13:01:03.827976 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 77/146] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:01:03 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:01:03.860507 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-835553af-5730-437d-9669-f9818c6ad8f1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:03.862835 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-835553af-5730-437d-9669-f9818c6ad8f1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:03.869076 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-835553af-5730-437d-9669-f9818c6ad8f1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:03.869597 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-835553af-5730-437d-9669-f9818c6ad8f1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:03.870036 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-835553af-5730-437d-9669-f9818c6ad8f1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:03.870730 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-835553af-5730-437d-9669-f9818c6ad8f1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:03.871182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-835553af-5730-437d-9669-f9818c6ad8f1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:03.871607 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-835553af-5730-437d-9669-f9818c6ad8f1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:03.894228 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-835553af-5730-437d-9669-f9818c6ad8f1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lazy-loading 'flavor' on Instance uuid 20015651-8ebe-44d9-9d4a-b4e15741c295 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:01:03.968356 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-835553af-5730-437d-9669-f9818c6ad8f1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "POST /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295/action" status: 200 len: 32 microversion: 2.1 time: 0.112278 Oct 14 13:01:03.969032 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 70/147] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Oct 14 13:01:03 2022] POST /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295/action => generated 32 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 13:01:03.978710 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-21bbe369-68c2-4e9a-8e2f-645682077844 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:03.979340 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-21bbe369-68c2-4e9a-8e2f-645682077844 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:03.985889 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21bbe369-68c2-4e9a-8e2f-645682077844 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:03.986547 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21bbe369-68c2-4e9a-8e2f-645682077844 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:03.986998 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21bbe369-68c2-4e9a-8e2f-645682077844 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:03.987683 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21bbe369-68c2-4e9a-8e2f-645682077844 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:03.988125 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21bbe369-68c2-4e9a-8e2f-645682077844 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:03.988538 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21bbe369-68c2-4e9a-8e2f-645682077844 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:04.123084 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-21bbe369-68c2-4e9a-8e2f-645682077844 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:04.130847 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-21bbe369-68c2-4e9a-8e2f-645682077844 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.155905 Oct 14 13:01:04.131415 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 78/148] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:03 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:04.853738 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-12e17229-fc5c-4108-90ae-c4463534546a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:04.854478 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-12e17229-fc5c-4108-90ae-c4463534546a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:04.861190 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12e17229-fc5c-4108-90ae-c4463534546a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:04.861910 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12e17229-fc5c-4108-90ae-c4463534546a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:04.862146 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12e17229-fc5c-4108-90ae-c4463534546a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:04.862871 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12e17229-fc5c-4108-90ae-c4463534546a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:04.863306 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12e17229-fc5c-4108-90ae-c4463534546a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:04.863722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12e17229-fc5c-4108-90ae-c4463534546a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:05.000739 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-12e17229-fc5c-4108-90ae-c4463534546a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:05.009517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-12e17229-fc5c-4108-90ae-c4463534546a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:05.010970 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-12e17229-fc5c-4108-90ae-c4463534546a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:05.012119 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-12e17229-fc5c-4108-90ae-c4463534546a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1406 microversion: 2.20 time: 0.163485 Oct 14 13:01:05.012676 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 71/149] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:01:04 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:01:05.154700 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c64abd46-0f51-4818-9867-1445c2667c09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:05.155356 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c64abd46-0f51-4818-9867-1445c2667c09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:05.163692 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c64abd46-0f51-4818-9867-1445c2667c09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:05.164532 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c64abd46-0f51-4818-9867-1445c2667c09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:05.165228 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c64abd46-0f51-4818-9867-1445c2667c09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:05.166034 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c64abd46-0f51-4818-9867-1445c2667c09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:05.166586 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c64abd46-0f51-4818-9867-1445c2667c09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:05.167078 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c64abd46-0f51-4818-9867-1445c2667c09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:05.342317 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c64abd46-0f51-4818-9867-1445c2667c09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:05.350104 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c64abd46-0f51-4818-9867-1445c2667c09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.200237 Oct 14 13:01:05.350643 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 79/150] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:05 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:01:06.036806 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-86c14752-6515-4fb5-8af8-ba92ad2389c0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:06.037394 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-86c14752-6515-4fb5-8af8-ba92ad2389c0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:06.044238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-86c14752-6515-4fb5-8af8-ba92ad2389c0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:06.044551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-86c14752-6515-4fb5-8af8-ba92ad2389c0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:06.044948 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-86c14752-6515-4fb5-8af8-ba92ad2389c0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:06.045669 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-86c14752-6515-4fb5-8af8-ba92ad2389c0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:06.046127 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-86c14752-6515-4fb5-8af8-ba92ad2389c0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:06.046658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-86c14752-6515-4fb5-8af8-ba92ad2389c0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:06.194802 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-86c14752-6515-4fb5-8af8-ba92ad2389c0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:06.203429 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-86c14752-6515-4fb5-8af8-ba92ad2389c0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:06.204878 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-86c14752-6515-4fb5-8af8-ba92ad2389c0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:06.206020 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-86c14752-6515-4fb5-8af8-ba92ad2389c0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1406 microversion: 2.20 time: 0.172987 Oct 14 13:01:06.206582 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 72/151] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:01:06 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:01:06.372995 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-df56e7b8-8f28-4a09-bcd8-4f697af3b58b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:06.373635 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-df56e7b8-8f28-4a09-bcd8-4f697af3b58b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:06.379792 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-df56e7b8-8f28-4a09-bcd8-4f697af3b58b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:06.380267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-df56e7b8-8f28-4a09-bcd8-4f697af3b58b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:06.380695 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-df56e7b8-8f28-4a09-bcd8-4f697af3b58b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:06.381372 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-df56e7b8-8f28-4a09-bcd8-4f697af3b58b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:06.381856 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-df56e7b8-8f28-4a09-bcd8-4f697af3b58b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:06.382275 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-df56e7b8-8f28-4a09-bcd8-4f697af3b58b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:06.506865 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-df56e7b8-8f28-4a09-bcd8-4f697af3b58b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:06.515410 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-df56e7b8-8f28-4a09-bcd8-4f697af3b58b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.146205 Oct 14 13:01:06.515965 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 80/152] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:06 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:07.231428 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ba19d5cc-f407-499e-aa2e-c102b5cb2d9a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:07.232068 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ba19d5cc-f407-499e-aa2e-c102b5cb2d9a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:07.238326 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ba19d5cc-f407-499e-aa2e-c102b5cb2d9a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:07.238840 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ba19d5cc-f407-499e-aa2e-c102b5cb2d9a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:07.239270 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ba19d5cc-f407-499e-aa2e-c102b5cb2d9a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:07.239948 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ba19d5cc-f407-499e-aa2e-c102b5cb2d9a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:07.240397 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ba19d5cc-f407-499e-aa2e-c102b5cb2d9a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:07.240817 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ba19d5cc-f407-499e-aa2e-c102b5cb2d9a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:07.372436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ba19d5cc-f407-499e-aa2e-c102b5cb2d9a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:07.381204 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ba19d5cc-f407-499e-aa2e-c102b5cb2d9a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:07.382789 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ba19d5cc-f407-499e-aa2e-c102b5cb2d9a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:07.383914 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ba19d5cc-f407-499e-aa2e-c102b5cb2d9a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1406 microversion: 2.20 time: 0.156486 Oct 14 13:01:07.384476 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 73/153] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:01:07 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:01:07.538141 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-072396b7-9388-4bda-a8ea-659e1ac48456 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:07.538694 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-072396b7-9388-4bda-a8ea-659e1ac48456 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:07.546161 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-072396b7-9388-4bda-a8ea-659e1ac48456 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:07.546644 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-072396b7-9388-4bda-a8ea-659e1ac48456 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:07.547112 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-072396b7-9388-4bda-a8ea-659e1ac48456 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:07.547798 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-072396b7-9388-4bda-a8ea-659e1ac48456 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:07.548246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-072396b7-9388-4bda-a8ea-659e1ac48456 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:07.548665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-072396b7-9388-4bda-a8ea-659e1ac48456 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:07.681223 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-072396b7-9388-4bda-a8ea-659e1ac48456 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:07.691313 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-072396b7-9388-4bda-a8ea-659e1ac48456 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.156995 Oct 14 13:01:07.691895 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 81/154] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:07 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:08.408796 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c465b037-759d-4483-baff-a81d3b59bada tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:08.410042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c465b037-759d-4483-baff-a81d3b59bada tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:08.412060 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:08.417282 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c465b037-759d-4483-baff-a81d3b59bada tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:08.417796 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c465b037-759d-4483-baff-a81d3b59bada tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:08.418230 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c465b037-759d-4483-baff-a81d3b59bada tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:08.418922 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c465b037-759d-4483-baff-a81d3b59bada tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:08.419373 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c465b037-759d-4483-baff-a81d3b59bada tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:08.419789 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c465b037-759d-4483-baff-a81d3b59bada tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:08.549527 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c465b037-759d-4483-baff-a81d3b59bada tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:08.558032 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c465b037-759d-4483-baff-a81d3b59bada tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:08.559477 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c465b037-759d-4483-baff-a81d3b59bada tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:08.560577 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c465b037-759d-4483-baff-a81d3b59bada tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1406 microversion: 2.20 time: 0.155749 Oct 14 13:01:08.561134 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 74/155] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:01:08 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:01:08.715114 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0a377a6e-42b5-40ec-933e-1a9d3ccef6bc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:08.715724 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0a377a6e-42b5-40ec-933e-1a9d3ccef6bc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:08.717559 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=2 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:08.718221 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=10 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:08.724512 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0a377a6e-42b5-40ec-933e-1a9d3ccef6bc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:08.724995 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0a377a6e-42b5-40ec-933e-1a9d3ccef6bc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:08.725430 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0a377a6e-42b5-40ec-933e-1a9d3ccef6bc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:08.726143 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0a377a6e-42b5-40ec-933e-1a9d3ccef6bc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:08.726591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0a377a6e-42b5-40ec-933e-1a9d3ccef6bc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:08.727015 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0a377a6e-42b5-40ec-933e-1a9d3ccef6bc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:08.878351 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0a377a6e-42b5-40ec-933e-1a9d3ccef6bc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:08.886451 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0a377a6e-42b5-40ec-933e-1a9d3ccef6bc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.175260 Oct 14 13:01:08.887003 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 82/156] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:08 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:09.586165 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8fc6b4d6-e0e1-41f0-9e80-a0757007df7b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:09.586733 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8fc6b4d6-e0e1-41f0-9e80-a0757007df7b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:09.592710 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fc6b4d6-e0e1-41f0-9e80-a0757007df7b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:09.593184 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fc6b4d6-e0e1-41f0-9e80-a0757007df7b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:09.593643 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fc6b4d6-e0e1-41f0-9e80-a0757007df7b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:09.594319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fc6b4d6-e0e1-41f0-9e80-a0757007df7b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:09.594770 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fc6b4d6-e0e1-41f0-9e80-a0757007df7b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:09.595192 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fc6b4d6-e0e1-41f0-9e80-a0757007df7b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:09.724697 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8fc6b4d6-e0e1-41f0-9e80-a0757007df7b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:09.733957 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8fc6b4d6-e0e1-41f0-9e80-a0757007df7b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:09.735668 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8fc6b4d6-e0e1-41f0-9e80-a0757007df7b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:09.736778 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8fc6b4d6-e0e1-41f0-9e80-a0757007df7b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1406 microversion: 2.20 time: 0.154648 Oct 14 13:01:09.737333 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 75/157] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:01:09 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:01:09.909299 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-24378960-a37b-40a8-8872-be57e83d6da1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:09.909956 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-24378960-a37b-40a8-8872-be57e83d6da1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:09.916769 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-24378960-a37b-40a8-8872-be57e83d6da1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:09.917229 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-24378960-a37b-40a8-8872-be57e83d6da1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:09.917699 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-24378960-a37b-40a8-8872-be57e83d6da1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:09.918372 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-24378960-a37b-40a8-8872-be57e83d6da1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:09.918815 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-24378960-a37b-40a8-8872-be57e83d6da1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:09.919229 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-24378960-a37b-40a8-8872-be57e83d6da1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:09.937849 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=100 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:10.049339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-24378960-a37b-40a8-8872-be57e83d6da1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:10.057613 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-24378960-a37b-40a8-8872-be57e83d6da1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.152274 Oct 14 13:01:10.058176 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 83/158] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:09 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:10.548098 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-934f72dc-fe2d-4774-9ce2-b16a95a17d9b req-0167d590-9f09-46ab-95a6-ad9e2d944a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f2bb08-a11d-46c6-96f5-9a9f85316fd0", "name": "network-vif-plugged", "status": "completed", "tag": "e3f9c588-4549-470d-90da-07db69916332"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:10.558534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-934f72dc-fe2d-4774-9ce2-b16a95a17d9b req-0167d590-9f09-46ab-95a6-ad9e2d944a52 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:10.559092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-934f72dc-fe2d-4774-9ce2-b16a95a17d9b req-0167d590-9f09-46ab-95a6-ad9e2d944a52 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:10.559720 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-934f72dc-fe2d-4774-9ce2-b16a95a17d9b req-0167d590-9f09-46ab-95a6-ad9e2d944a52 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:10.572105 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-934f72dc-fe2d-4774-9ce2-b16a95a17d9b req-0167d590-9f09-46ab-95a6-ad9e2d944a52 service nova] Creating event network-vif-plugged:e3f9c588-4549-470d-90da-07db69916332 for instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 on hv-cinder-82099 Oct 14 13:01:10.578762 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-934f72dc-fe2d-4774-9ce2-b16a95a17d9b req-0167d590-9f09-46ab-95a6-ad9e2d944a52 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034955 Oct 14 13:01:10.579937 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 76/159] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:01:10.762295 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-8d994f8c-78e8-49fe-a00a-dfe34ffa3716 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:10.763152 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-8d994f8c-78e8-49fe-a00a-dfe34ffa3716 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:10.769023 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8d994f8c-78e8-49fe-a00a-dfe34ffa3716 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:10.769529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8d994f8c-78e8-49fe-a00a-dfe34ffa3716 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:10.769968 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8d994f8c-78e8-49fe-a00a-dfe34ffa3716 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:10.770657 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8d994f8c-78e8-49fe-a00a-dfe34ffa3716 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:10.771100 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8d994f8c-78e8-49fe-a00a-dfe34ffa3716 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:10.771531 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8d994f8c-78e8-49fe-a00a-dfe34ffa3716 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:11.033787 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-8d994f8c-78e8-49fe-a00a-dfe34ffa3716 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:11.044933 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-8d994f8c-78e8-49fe-a00a-dfe34ffa3716 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:11.047045 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-8d994f8c-78e8-49fe-a00a-dfe34ffa3716 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:11.048387 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-8d994f8c-78e8-49fe-a00a-dfe34ffa3716 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1406 microversion: 2.20 time: 0.290683 Oct 14 13:01:11.049152 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 84/160] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:01:10 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:01:11.082613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4676b1c3-7c45-4f4d-abad-ad9f0a29638f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:11.084081 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4676b1c3-7c45-4f4d-abad-ad9f0a29638f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:11.091494 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4676b1c3-7c45-4f4d-abad-ad9f0a29638f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:11.092177 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4676b1c3-7c45-4f4d-abad-ad9f0a29638f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:11.092799 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4676b1c3-7c45-4f4d-abad-ad9f0a29638f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:11.093708 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4676b1c3-7c45-4f4d-abad-ad9f0a29638f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:11.094338 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4676b1c3-7c45-4f4d-abad-ad9f0a29638f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:11.094917 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4676b1c3-7c45-4f4d-abad-ad9f0a29638f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:11.267308 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4676b1c3-7c45-4f4d-abad-ad9f0a29638f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:11.275387 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4676b1c3-7c45-4f4d-abad-ad9f0a29638f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.197853 Oct 14 13:01:11.275961 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 77/161] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:11 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:12.072875 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-a9819ede-0774-432b-870d-e039fcc3f621 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:12.073514 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-a9819ede-0774-432b-870d-e039fcc3f621 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:12.080075 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a9819ede-0774-432b-870d-e039fcc3f621 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:12.080567 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a9819ede-0774-432b-870d-e039fcc3f621 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:12.081082 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a9819ede-0774-432b-870d-e039fcc3f621 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:12.081807 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a9819ede-0774-432b-870d-e039fcc3f621 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:12.082265 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a9819ede-0774-432b-870d-e039fcc3f621 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:12.082688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a9819ede-0774-432b-870d-e039fcc3f621 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:12.223610 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-a9819ede-0774-432b-870d-e039fcc3f621 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:12.232823 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-a9819ede-0774-432b-870d-e039fcc3f621 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:12.234578 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-a9819ede-0774-432b-870d-e039fcc3f621 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:12.235693 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-a9819ede-0774-432b-870d-e039fcc3f621 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1406 microversion: 2.20 time: 0.167038 Oct 14 13:01:12.236249 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 85/162] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:01:12 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:01:12.297998 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-155d21d0-2a5c-4bd9-a651-394ba3b46d69 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:12.298603 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-155d21d0-2a5c-4bd9-a651-394ba3b46d69 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:12.304745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-155d21d0-2a5c-4bd9-a651-394ba3b46d69 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:12.306682 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-155d21d0-2a5c-4bd9-a651-394ba3b46d69 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:12.307286 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-155d21d0-2a5c-4bd9-a651-394ba3b46d69 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:12.308148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-155d21d0-2a5c-4bd9-a651-394ba3b46d69 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:12.308838 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-155d21d0-2a5c-4bd9-a651-394ba3b46d69 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:12.309414 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-155d21d0-2a5c-4bd9-a651-394ba3b46d69 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:12.458291 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-155d21d0-2a5c-4bd9-a651-394ba3b46d69 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:12.462429 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:12.467974 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-155d21d0-2a5c-4bd9-a651-394ba3b46d69 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.173750 Oct 14 13:01:12.468760 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 78/163] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:12 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:13.260631 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-871761a0-60d4-4713-af0e-b575dfc13317 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:13.261313 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-871761a0-60d4-4713-af0e-b575dfc13317 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:13.267835 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-871761a0-60d4-4713-af0e-b575dfc13317 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:13.268320 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-871761a0-60d4-4713-af0e-b575dfc13317 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:13.268811 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-871761a0-60d4-4713-af0e-b575dfc13317 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:13.269528 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-871761a0-60d4-4713-af0e-b575dfc13317 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:13.269988 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-871761a0-60d4-4713-af0e-b575dfc13317 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:13.270417 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-871761a0-60d4-4713-af0e-b575dfc13317 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:13.402267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-871761a0-60d4-4713-af0e-b575dfc13317 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:13.412670 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-871761a0-60d4-4713-af0e-b575dfc13317 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:13.414264 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-871761a0-60d4-4713-af0e-b575dfc13317 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:13.415941 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-871761a0-60d4-4713-af0e-b575dfc13317 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1599 microversion: 2.20 time: 0.159627 Oct 14 13:01:13.417198 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 86/164] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:01:13 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:01:13.441290 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c005677d-c7b6-4a1f-a258-d757d7a3d8b0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:13.441818 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c005677d-c7b6-4a1f-a258-d757d7a3d8b0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:13.449360 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c005677d-c7b6-4a1f-a258-d757d7a3d8b0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:13.449881 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c005677d-c7b6-4a1f-a258-d757d7a3d8b0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:13.450319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c005677d-c7b6-4a1f-a258-d757d7a3d8b0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:13.451010 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c005677d-c7b6-4a1f-a258-d757d7a3d8b0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:13.451461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c005677d-c7b6-4a1f-a258-d757d7a3d8b0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:13.451886 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c005677d-c7b6-4a1f-a258-d757d7a3d8b0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:13.491752 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-db8dc811-3bee-44c8-bf5e-8eb133733c7c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:13.492463 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-db8dc811-3bee-44c8-bf5e-8eb133733c7c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:13.498583 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-db8dc811-3bee-44c8-bf5e-8eb133733c7c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:13.499191 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-db8dc811-3bee-44c8-bf5e-8eb133733c7c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:13.499852 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-db8dc811-3bee-44c8-bf5e-8eb133733c7c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:13.500554 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-db8dc811-3bee-44c8-bf5e-8eb133733c7c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:13.501002 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-db8dc811-3bee-44c8-bf5e-8eb133733c7c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:13.501753 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-db8dc811-3bee-44c8-bf5e-8eb133733c7c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:13.534439 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c005677d-c7b6-4a1f-a258-d757d7a3d8b0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.097124 Oct 14 13:01:13.535257 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 79/165] 10.222.0.47 () {60 vars in 1316 bytes} [Fri Oct 14 13:01:13 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 13:01:13.644785 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-db8dc811-3bee-44c8-bf5e-8eb133733c7c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:13.660412 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-db8dc811-3bee-44c8-bf5e-8eb133733c7c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.173247 Oct 14 13:01:13.660983 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 87/166] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:13 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:01:14.684558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-fdedc358-bf82-4fcf-afca-73c04505e4df tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:14.685195 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-fdedc358-bf82-4fcf-afca-73c04505e4df tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:14.691050 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdedc358-bf82-4fcf-afca-73c04505e4df tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:14.691530 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdedc358-bf82-4fcf-afca-73c04505e4df tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:14.691966 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdedc358-bf82-4fcf-afca-73c04505e4df tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:14.692648 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdedc358-bf82-4fcf-afca-73c04505e4df tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:14.693096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdedc358-bf82-4fcf-afca-73c04505e4df tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:14.693535 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdedc358-bf82-4fcf-afca-73c04505e4df tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:14.923854 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-fdedc358-bf82-4fcf-afca-73c04505e4df tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:14.932030 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-fdedc358-bf82-4fcf-afca-73c04505e4df tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.251954 Oct 14 13:01:14.933674 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 80/167] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:14 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:14.976991 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-045597e7-da86-482e-b99c-e966a490e6d3 req-a88effea-982c-4d5b-99e2-48e178583a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8f2bb08-a11d-46c6-96f5-9a9f85316fd0", "tag": "e3f9c588-4549-470d-90da-07db69916332"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:14.983483 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:14.990073 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-045597e7-da86-482e-b99c-e966a490e6d3 req-a88effea-982c-4d5b-99e2-48e178583a54 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:14.990541 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-045597e7-da86-482e-b99c-e966a490e6d3 req-a88effea-982c-4d5b-99e2-48e178583a54 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:14.990961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-045597e7-da86-482e-b99c-e966a490e6d3 req-a88effea-982c-4d5b-99e2-48e178583a54 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:15.003183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-045597e7-da86-482e-b99c-e966a490e6d3 req-a88effea-982c-4d5b-99e2-48e178583a54 service nova] Creating event network-changed:e3f9c588-4549-470d-90da-07db69916332 for instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 on hv-cinder-82099 Oct 14 13:01:15.009090 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-045597e7-da86-482e-b99c-e966a490e6d3 req-a88effea-982c-4d5b-99e2-48e178583a54 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035161 Oct 14 13:01:15.009710 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 88/168] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:01:15.955815 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c64a8fa1-a4d9-489e-a208-11824a72808f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:15.956421 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c64a8fa1-a4d9-489e-a208-11824a72808f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:15.962771 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c64a8fa1-a4d9-489e-a208-11824a72808f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:15.963259 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c64a8fa1-a4d9-489e-a208-11824a72808f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:15.963690 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c64a8fa1-a4d9-489e-a208-11824a72808f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:15.964385 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c64a8fa1-a4d9-489e-a208-11824a72808f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:15.964837 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c64a8fa1-a4d9-489e-a208-11824a72808f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:15.965257 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c64a8fa1-a4d9-489e-a208-11824a72808f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:16.101922 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c64a8fa1-a4d9-489e-a208-11824a72808f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:16.109467 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c64a8fa1-a4d9-489e-a208-11824a72808f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.157271 Oct 14 13:01:16.110057 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 81/169] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:15 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:17.133602 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0225acbe-00bc-48c2-94ea-5bb6f5ef1c05 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:17.134296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0225acbe-00bc-48c2-94ea-5bb6f5ef1c05 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:17.140784 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0225acbe-00bc-48c2-94ea-5bb6f5ef1c05 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:17.141258 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0225acbe-00bc-48c2-94ea-5bb6f5ef1c05 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:17.141733 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0225acbe-00bc-48c2-94ea-5bb6f5ef1c05 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:17.142487 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0225acbe-00bc-48c2-94ea-5bb6f5ef1c05 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:17.142990 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0225acbe-00bc-48c2-94ea-5bb6f5ef1c05 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:17.143446 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0225acbe-00bc-48c2-94ea-5bb6f5ef1c05 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:17.277457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0225acbe-00bc-48c2-94ea-5bb6f5ef1c05 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:17.285117 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0225acbe-00bc-48c2-94ea-5bb6f5ef1c05 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.156181 Oct 14 13:01:17.285712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 89/170] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:17 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:18.308022 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cf6e5d49-aa78-446c-96ca-ef311b75f3e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:18.308686 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-cf6e5d49-aa78-446c-96ca-ef311b75f3e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:18.314637 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf6e5d49-aa78-446c-96ca-ef311b75f3e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:18.315148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf6e5d49-aa78-446c-96ca-ef311b75f3e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:18.315577 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf6e5d49-aa78-446c-96ca-ef311b75f3e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:18.316286 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf6e5d49-aa78-446c-96ca-ef311b75f3e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:18.316735 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf6e5d49-aa78-446c-96ca-ef311b75f3e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:18.317152 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf6e5d49-aa78-446c-96ca-ef311b75f3e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:18.446047 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-cf6e5d49-aa78-446c-96ca-ef311b75f3e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:18.453978 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-cf6e5d49-aa78-446c-96ca-ef311b75f3e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.150228 Oct 14 13:01:18.454544 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 82/171] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:18 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:19.476682 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-a192185b-a9b6-4a80-b662-1433ca876f4d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:19.477314 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-a192185b-a9b6-4a80-b662-1433ca876f4d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:19.484001 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a192185b-a9b6-4a80-b662-1433ca876f4d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:19.484799 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a192185b-a9b6-4a80-b662-1433ca876f4d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:19.485231 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a192185b-a9b6-4a80-b662-1433ca876f4d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:19.485949 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a192185b-a9b6-4a80-b662-1433ca876f4d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:19.486398 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a192185b-a9b6-4a80-b662-1433ca876f4d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:19.486815 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a192185b-a9b6-4a80-b662-1433ca876f4d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:19.616518 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-a192185b-a9b6-4a80-b662-1433ca876f4d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:19.624301 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-a192185b-a9b6-4a80-b662-1433ca876f4d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.151457 Oct 14 13:01:19.624879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 90/172] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:19 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:20.648086 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7bdf8b7f-3398-4843-9ca7-493621f8ee8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:20.648694 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7bdf8b7f-3398-4843-9ca7-493621f8ee8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:20.655250 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bdf8b7f-3398-4843-9ca7-493621f8ee8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:20.655735 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bdf8b7f-3398-4843-9ca7-493621f8ee8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:20.656392 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bdf8b7f-3398-4843-9ca7-493621f8ee8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:20.656846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bdf8b7f-3398-4843-9ca7-493621f8ee8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:20.657390 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bdf8b7f-3398-4843-9ca7-493621f8ee8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:20.657909 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bdf8b7f-3398-4843-9ca7-493621f8ee8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:20.788993 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7bdf8b7f-3398-4843-9ca7-493621f8ee8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:20.797269 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7bdf8b7f-3398-4843-9ca7-493621f8ee8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.153221 Oct 14 13:01:20.797854 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 83/173] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:20 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:21.819024 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-a28ccac7-5e80-4abc-9d9f-6ebdc9c753c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:21.819664 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-a28ccac7-5e80-4abc-9d9f-6ebdc9c753c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:21.825755 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a28ccac7-5e80-4abc-9d9f-6ebdc9c753c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:21.826238 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a28ccac7-5e80-4abc-9d9f-6ebdc9c753c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:21.826673 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a28ccac7-5e80-4abc-9d9f-6ebdc9c753c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:21.827355 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a28ccac7-5e80-4abc-9d9f-6ebdc9c753c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:21.827807 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a28ccac7-5e80-4abc-9d9f-6ebdc9c753c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:21.828230 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a28ccac7-5e80-4abc-9d9f-6ebdc9c753c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:21.952173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-a28ccac7-5e80-4abc-9d9f-6ebdc9c753c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:21.959701 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-a28ccac7-5e80-4abc-9d9f-6ebdc9c753c6 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.144524 Oct 14 13:01:21.960268 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 91/174] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:21 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:22.983493 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-26940452-8fe5-4b76-ab8c-f4e66c11158b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:22.984095 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-26940452-8fe5-4b76-ab8c-f4e66c11158b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:22.986293 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=50 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:22.991562 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-26940452-8fe5-4b76-ab8c-f4e66c11158b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:22.992040 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-26940452-8fe5-4b76-ab8c-f4e66c11158b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:22.993046 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-26940452-8fe5-4b76-ab8c-f4e66c11158b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:22.993716 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-26940452-8fe5-4b76-ab8c-f4e66c11158b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:22.994164 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-26940452-8fe5-4b76-ab8c-f4e66c11158b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:22.994580 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-26940452-8fe5-4b76-ab8c-f4e66c11158b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:23.119388 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-26940452-8fe5-4b76-ab8c-f4e66c11158b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:23.127003 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-26940452-8fe5-4b76-ab8c-f4e66c11158b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.147412 Oct 14 13:01:23.127556 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 84/175] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:22 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:24.150002 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b3db9cab-44b1-4191-a1e5-7c2f0f2b1d44 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:24.150610 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b3db9cab-44b1-4191-a1e5-7c2f0f2b1d44 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:24.157068 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b3db9cab-44b1-4191-a1e5-7c2f0f2b1d44 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:24.157642 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b3db9cab-44b1-4191-a1e5-7c2f0f2b1d44 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:24.158080 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b3db9cab-44b1-4191-a1e5-7c2f0f2b1d44 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:24.158764 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b3db9cab-44b1-4191-a1e5-7c2f0f2b1d44 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:24.159213 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b3db9cab-44b1-4191-a1e5-7c2f0f2b1d44 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:24.159634 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b3db9cab-44b1-4191-a1e5-7c2f0f2b1d44 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:24.288790 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b3db9cab-44b1-4191-a1e5-7c2f0f2b1d44 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:24.296981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b3db9cab-44b1-4191-a1e5-7c2f0f2b1d44 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.150878 Oct 14 13:01:24.297557 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 92/176] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:24 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:25.131563 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-38ca9d3f-3830-45c8-90fe-1ac580955c94 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:25.132110 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-38ca9d3f-3830-45c8-90fe-1ac580955c94 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:25.138840 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-38ca9d3f-3830-45c8-90fe-1ac580955c94 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:25.139328 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-38ca9d3f-3830-45c8-90fe-1ac580955c94 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:25.139766 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-38ca9d3f-3830-45c8-90fe-1ac580955c94 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:25.140463 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-38ca9d3f-3830-45c8-90fe-1ac580955c94 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:25.140911 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-38ca9d3f-3830-45c8-90fe-1ac580955c94 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:25.141406 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-38ca9d3f-3830-45c8-90fe-1ac580955c94 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:25.166133 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-38ca9d3f-3830-45c8-90fe-1ac580955c94 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6/ips" status: 200 len: 149 microversion: 2.1 time: 0.039343 Oct 14 13:01:25.173225 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 85/177] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Oct 14 13:01:25 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:01:25.320229 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1f8ea165-480e-4ab4-8a2c-ea2ff288f4d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:25.321161 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1f8ea165-480e-4ab4-8a2c-ea2ff288f4d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:25.327492 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f8ea165-480e-4ab4-8a2c-ea2ff288f4d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:25.328207 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f8ea165-480e-4ab4-8a2c-ea2ff288f4d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:25.328640 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f8ea165-480e-4ab4-8a2c-ea2ff288f4d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:25.329333 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f8ea165-480e-4ab4-8a2c-ea2ff288f4d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:25.329831 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f8ea165-480e-4ab4-8a2c-ea2ff288f4d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:25.330272 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f8ea165-480e-4ab4-8a2c-ea2ff288f4d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:25.469421 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-1f8ea165-480e-4ab4-8a2c-ea2ff288f4d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:25.478487 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1f8ea165-480e-4ab4-8a2c-ea2ff288f4d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.162094 Oct 14 13:01:25.479327 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 93/178] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:25 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:01:26.502021 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d668b2c8-1069-446b-861c-7ca54b90c999 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:26.503128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-d668b2c8-1069-446b-861c-7ca54b90c999 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:26.510772 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d668b2c8-1069-446b-861c-7ca54b90c999 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:26.511440 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d668b2c8-1069-446b-861c-7ca54b90c999 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:26.511879 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d668b2c8-1069-446b-861c-7ca54b90c999 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:26.512904 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d668b2c8-1069-446b-861c-7ca54b90c999 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:26.513606 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d668b2c8-1069-446b-861c-7ca54b90c999 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:26.514388 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d668b2c8-1069-446b-861c-7ca54b90c999 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:26.552942 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-822ea16a-ae60-4df3-a740-52cf3b67d0c4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a930cf3-00fb-42d3-8326-97367f550838"}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:26.556043 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-822ea16a-ae60-4df3-a740-52cf3b67d0c4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:26.562980 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-822ea16a-ae60-4df3-a740-52cf3b67d0c4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:26.563455 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-822ea16a-ae60-4df3-a740-52cf3b67d0c4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:26.563883 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-822ea16a-ae60-4df3-a740-52cf3b67d0c4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:26.564567 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-822ea16a-ae60-4df3-a740-52cf3b67d0c4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:26.565012 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-822ea16a-ae60-4df3-a740-52cf3b67d0c4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:26.565418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-822ea16a-ae60-4df3-a740-52cf3b67d0c4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:26.686686 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-d668b2c8-1069-446b-861c-7ca54b90c999 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:26.706623 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-d668b2c8-1069-446b-861c-7ca54b90c999 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.196856 Oct 14 13:01:26.707313 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 86/179] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:26 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:27.731258 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4783ac39-37d4-41e3-8664-44f93c06bf19 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:27.731856 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4783ac39-37d4-41e3-8664-44f93c06bf19 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:27.739512 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4783ac39-37d4-41e3-8664-44f93c06bf19 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:27.739512 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4783ac39-37d4-41e3-8664-44f93c06bf19 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:27.739705 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4783ac39-37d4-41e3-8664-44f93c06bf19 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:27.740464 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4783ac39-37d4-41e3-8664-44f93c06bf19 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:27.741055 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4783ac39-37d4-41e3-8664-44f93c06bf19 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:27.741559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4783ac39-37d4-41e3-8664-44f93c06bf19 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:27.874552 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4783ac39-37d4-41e3-8664-44f93c06bf19 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:27.883329 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4783ac39-37d4-41e3-8664-44f93c06bf19 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.156139 Oct 14 13:01:27.884128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 87/180] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:27 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:28.827609 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c301156d-ea42-4d57-9f6a-2520399acee3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:28.828181 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c301156d-ea42-4d57-9f6a-2520399acee3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:28.834283 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c301156d-ea42-4d57-9f6a-2520399acee3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:28.835789 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c301156d-ea42-4d57-9f6a-2520399acee3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:28.836183 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c301156d-ea42-4d57-9f6a-2520399acee3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:28.836875 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c301156d-ea42-4d57-9f6a-2520399acee3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:28.837320 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c301156d-ea42-4d57-9f6a-2520399acee3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:28.837761 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c301156d-ea42-4d57-9f6a-2520399acee3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:28.860762 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c301156d-ea42-4d57-9f6a-2520399acee3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/ips" status: 200 len: 146 microversion: 2.1 time: 0.036956 Oct 14 13:01:28.861307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 88/181] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Oct 14 13:01:28 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:01:28.908162 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a4dc4f0b-2c7b-441c-9bea-50d3706f807f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:28.908774 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-a4dc4f0b-2c7b-441c-9bea-50d3706f807f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:28.915043 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a4dc4f0b-2c7b-441c-9bea-50d3706f807f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:28.915531 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a4dc4f0b-2c7b-441c-9bea-50d3706f807f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:28.915966 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a4dc4f0b-2c7b-441c-9bea-50d3706f807f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:28.916719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a4dc4f0b-2c7b-441c-9bea-50d3706f807f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:28.917169 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a4dc4f0b-2c7b-441c-9bea-50d3706f807f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:28.917621 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a4dc4f0b-2c7b-441c-9bea-50d3706f807f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:29.036573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-822ea16a-ae60-4df3-a740-52cf3b67d0c4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "POST /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.487445 Oct 14 13:01:29.037558 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 94/182] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Oct 14 13:01:26 2022] POST /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6/os-volume_attachments => generated 194 bytes in 2489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:01:29.055358 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a4dc4f0b-2c7b-441c-9bea-50d3706f807f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:29.066070 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-a4dc4f0b-2c7b-441c-9bea-50d3706f807f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.162018 Oct 14 13:01:29.066850 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 89/183] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:28 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:30.091373 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d829fb4f-02fe-42a8-8e2b-f20bae15cf65 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:30.092896 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-d829fb4f-02fe-42a8-8e2b-f20bae15cf65 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:30.103586 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d829fb4f-02fe-42a8-8e2b-f20bae15cf65 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:30.104605 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d829fb4f-02fe-42a8-8e2b-f20bae15cf65 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:30.105351 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d829fb4f-02fe-42a8-8e2b-f20bae15cf65 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:30.106308 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d829fb4f-02fe-42a8-8e2b-f20bae15cf65 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:30.107179 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d829fb4f-02fe-42a8-8e2b-f20bae15cf65 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:30.107712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d829fb4f-02fe-42a8-8e2b-f20bae15cf65 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:30.283134 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-d829fb4f-02fe-42a8-8e2b-f20bae15cf65 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:30.291717 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-d829fb4f-02fe-42a8-8e2b-f20bae15cf65 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.205926 Oct 14 13:01:30.292286 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 95/184] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:30 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:31.319730 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7bafad4c-32ea-4e09-9fc6-c8bdf45e779e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:31.320383 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7bafad4c-32ea-4e09-9fc6-c8bdf45e779e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:31.327046 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bafad4c-32ea-4e09-9fc6-c8bdf45e779e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:31.327542 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bafad4c-32ea-4e09-9fc6-c8bdf45e779e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:31.328021 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bafad4c-32ea-4e09-9fc6-c8bdf45e779e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:31.328638 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bafad4c-32ea-4e09-9fc6-c8bdf45e779e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:31.329086 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bafad4c-32ea-4e09-9fc6-c8bdf45e779e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:31.329533 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bafad4c-32ea-4e09-9fc6-c8bdf45e779e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:31.465463 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7bafad4c-32ea-4e09-9fc6-c8bdf45e779e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:31.473103 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7bafad4c-32ea-4e09-9fc6-c8bdf45e779e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.157168 Oct 14 13:01:31.473688 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 90/185] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:31 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:32.499342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-93f8868e-b33d-44f2-97e4-5a03f0c4765d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:32.499342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-93f8868e-b33d-44f2-97e4-5a03f0c4765d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:32.504314 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-93f8868e-b33d-44f2-97e4-5a03f0c4765d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:32.504815 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-93f8868e-b33d-44f2-97e4-5a03f0c4765d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:32.505246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-93f8868e-b33d-44f2-97e4-5a03f0c4765d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:32.505992 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-93f8868e-b33d-44f2-97e4-5a03f0c4765d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:32.506480 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-93f8868e-b33d-44f2-97e4-5a03f0c4765d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:32.506903 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-93f8868e-b33d-44f2-97e4-5a03f0c4765d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:32.646650 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-93f8868e-b33d-44f2-97e4-5a03f0c4765d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:32.655126 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-93f8868e-b33d-44f2-97e4-5a03f0c4765d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1501 microversion: 2.1 time: 0.162253 Oct 14 13:01:32.669718 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 96/186] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:32 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1501 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:32.677959 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cdce98e6-0686-4aa2-8157-7d90805dc6b9 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c05ae93c-8588-4677-8119-1c5a13d4f863"}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:32.680981 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-cdce98e6-0686-4aa2-8157-7d90805dc6b9 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:32.687720 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cdce98e6-0686-4aa2-8157-7d90805dc6b9 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:32.688227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cdce98e6-0686-4aa2-8157-7d90805dc6b9 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:32.689126 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cdce98e6-0686-4aa2-8157-7d90805dc6b9 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:32.689875 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cdce98e6-0686-4aa2-8157-7d90805dc6b9 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:32.690807 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cdce98e6-0686-4aa2-8157-7d90805dc6b9 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:32.691239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cdce98e6-0686-4aa2-8157-7d90805dc6b9 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:32.715993 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-cdce98e6-0686-4aa2-8157-7d90805dc6b9 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] HTTP exception thrown: Cannot 'attach_volume' instance 20015651-8ebe-44d9-9d4a-b4e15741c295 while it is in vm_state rescued Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cdce98e6-0686-4aa2-8157-7d90805dc6b9 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Request method failure captured: Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: POST /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295/os-volume_attachments HTTP/1.1 Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 74 Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1Cs09Cu8vSps46z6W6PeSQaPlaz7RbycBpbAaKGyNLkJbBPIE899Agnc8xKbSQMAp8rE7tSu7AwxUpIowQS4vJkiL31SuEvGTrM_qnAchngAi6kRbyLURlB3MBaW58J1FeYinNbeUIsTaDmwhcpSEQThHsj_MktdqLjb4gv2tw8pQ Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: c160176d8c804b7793bae21c205c538c Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-284328419 Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:01:32.717719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:01:32.719166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c160176d8c804b7793bae21c205c538c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c160176d8c804b7793bae21c205c538c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c160176d8c804b7793bae21c205c538c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c160176d8c804b7793bae21c205c538c", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:01:32.719166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-284328419 Oct 14 13:01:32.719166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: c160176d8c804b7793bae21c205c538c Oct 14 13:01:32.719166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-284328419 Oct 14 13:01:32.719166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-ServerRescueNegativeTestJSON-284328419-project Oct 14 13:01:32.719166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:01:32.719166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:01:32.719166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 60860294eb284b8aa11edd42dca4ae8d Oct 14 13:01:32.719166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-284328419-project Oct 14 13:01:32.719166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Oct 14 13:01:32.719166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {"volumeAttachment": {"volumeId": "c05ae93c-8588-4677-8119-1c5a13d4f863"}} Oct 14 13:01:32.719166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Cannot 'attach_volume' instance 20015651-8ebe-44d9-9d4a-b4e15741c295 while it is in vm_state rescued Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'server_id': '20015651-8ebe-44d9-9d4a-b4e15741c295', 'body': {'volumeAttachment': {'volumeId': 'c05ae93c-8588-4677-8119-1c5a13d4f863'}}} Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 20015651-8ebe-44d9-9d4a-b4e15741c295 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:01:32.720018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 20015651-8ebe-44d9-9d4a-b4e15741c295 while it is in vm_state rescued Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:01:32.721312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:01:32.722577 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:01:32.722577 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:01:32.722577 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 20015651-8ebe-44d9-9d4a-b4e15741c295 while it is in vm_state rescued Oct 14 13:01:32.722577 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:01:32.722577 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cdce98e6-0686-4aa2-8157-7d90805dc6b9 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Returning 409 to user: Cannot 'attach_volume' instance 20015651-8ebe-44d9-9d4a-b4e15741c295 while it is in vm_state rescued {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:01:32.722577 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-cdce98e6-0686-4aa2-8157-7d90805dc6b9 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "POST /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045178 Oct 14 13:01:32.722577 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 91/187] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Oct 14 13:01:32 2022] POST /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 14 13:01:32.728974 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c400f2c4-be53-41c7-bb20-531fba79f3be tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:32.729794 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c400f2c4-be53-41c7-bb20-531fba79f3be tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:32.735732 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c400f2c4-be53-41c7-bb20-531fba79f3be tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:32.736217 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c400f2c4-be53-41c7-bb20-531fba79f3be tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:32.736654 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c400f2c4-be53-41c7-bb20-531fba79f3be tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:32.737873 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c400f2c4-be53-41c7-bb20-531fba79f3be tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:32.738337 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c400f2c4-be53-41c7-bb20-531fba79f3be tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:32.738761 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c400f2c4-be53-41c7-bb20-531fba79f3be tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:32.809307 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c400f2c4-be53-41c7-bb20-531fba79f3be tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "POST /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295/action" status: 202 len: 0 microversion: 2.1 time: 0.084566 Oct 14 13:01:32.810324 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 97/188] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Oct 14 13:01:32 2022] POST /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:01:32.818330 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-17fb5a68-d110-4a0d-ab86-79ce3a8fecd8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:32.819115 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-17fb5a68-d110-4a0d-ab86-79ce3a8fecd8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:32.826876 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-17fb5a68-d110-4a0d-ab86-79ce3a8fecd8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:32.827352 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-17fb5a68-d110-4a0d-ab86-79ce3a8fecd8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:32.827964 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-17fb5a68-d110-4a0d-ab86-79ce3a8fecd8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:32.828943 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-17fb5a68-d110-4a0d-ab86-79ce3a8fecd8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:32.829385 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-17fb5a68-d110-4a0d-ab86-79ce3a8fecd8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:32.830137 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-17fb5a68-d110-4a0d-ab86-79ce3a8fecd8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:32.972705 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-17fb5a68-d110-4a0d-ab86-79ce3a8fecd8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:32.991065 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-17fb5a68-d110-4a0d-ab86-79ce3a8fecd8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1509 microversion: 2.1 time: 0.176424 Oct 14 13:01:32.992275 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 92/189] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:32 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:33.136855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-845209410", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452"}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:33.194553 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.network.neutron [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] validate_networks() for None {{(pid=118868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:01:33.646944 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Flavor limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:01:33.647528 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Image limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:01:33.648139 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Flavor pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:01:33.648586 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Image pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:01:33.649049 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:01:33.658015 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:33.658496 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:33.658928 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:33.659650 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:33.660173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:33.660600 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:33.678703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Getting quotas for project 159e3573c405472baf7efac53e8a7b99. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:01:33.684244 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Getting quotas for user fdf8adbf99e640de8419efe9d8640b47 and project 159e3573c405472baf7efac53e8a7b99. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:01:33.696654 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Going to run 1 instances... {{(pid=118868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:01:33.699359 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:01:33.760618 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-00a7a438-fa6b-4470-a333-ba1cb94703b9 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629488 Oct 14 13:01:33.761451 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 98/190] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:01:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 13:01:33.772590 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d0b3518c-a4f2-477e-b614-27dea384bce5 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:33.773955 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-d0b3518c-a4f2-477e-b614-27dea384bce5 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:33.843499 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-d0b3518c-a4f2-477e-b614-27dea384bce5 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:33.857740 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-d0b3518c-a4f2-477e-b614-27dea384bce5 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1214 microversion: 2.1 time: 0.089146 Oct 14 13:01:33.858320 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 93/191] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:33 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:34.016312 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-57d05e9f-c176-4921-ad8f-a066cccafc09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:34.017261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-57d05e9f-c176-4921-ad8f-a066cccafc09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:34.026028 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-57d05e9f-c176-4921-ad8f-a066cccafc09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:34.026618 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-57d05e9f-c176-4921-ad8f-a066cccafc09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:34.027121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-57d05e9f-c176-4921-ad8f-a066cccafc09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:34.029033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-57d05e9f-c176-4921-ad8f-a066cccafc09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:34.029826 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-57d05e9f-c176-4921-ad8f-a066cccafc09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:34.030479 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-57d05e9f-c176-4921-ad8f-a066cccafc09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:34.038327 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:34.279679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-57d05e9f-c176-4921-ad8f-a066cccafc09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:34.290300 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-57d05e9f-c176-4921-ad8f-a066cccafc09 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1509 microversion: 2.1 time: 0.278458 Oct 14 13:01:34.297510 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 99/192] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:34 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:34.882088 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-378f13e5-ab94-496f-bfef-36acf4b3d22b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:34.882706 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-378f13e5-ab94-496f-bfef-36acf4b3d22b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:34.889309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-378f13e5-ab94-496f-bfef-36acf4b3d22b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:34.889831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-378f13e5-ab94-496f-bfef-36acf4b3d22b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:34.890260 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-378f13e5-ab94-496f-bfef-36acf4b3d22b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:34.890935 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-378f13e5-ab94-496f-bfef-36acf4b3d22b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:34.891382 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-378f13e5-ab94-496f-bfef-36acf4b3d22b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:34.891799 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-378f13e5-ab94-496f-bfef-36acf4b3d22b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:34.951734 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-378f13e5-ab94-496f-bfef-36acf4b3d22b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:34.959301 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-378f13e5-ab94-496f-bfef-36acf4b3d22b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1218 microversion: 2.1 time: 0.081095 Oct 14 13:01:34.959849 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 94/193] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:34 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:35.278349 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1d09896e-9e79-4970-a095-bde7769e3e9c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a18e205-b8e1-4cd0-986c-d455b239035a"}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:35.280754 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1d09896e-9e79-4970-a095-bde7769e3e9c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:35.287923 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d09896e-9e79-4970-a095-bde7769e3e9c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:35.288407 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d09896e-9e79-4970-a095-bde7769e3e9c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:35.289362 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d09896e-9e79-4970-a095-bde7769e3e9c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:35.290080 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d09896e-9e79-4970-a095-bde7769e3e9c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:35.290549 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d09896e-9e79-4970-a095-bde7769e3e9c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:35.290969 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d09896e-9e79-4970-a095-bde7769e3e9c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:35.322616 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4c3ea295-c45f-4caa-bef0-11442a85452c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:35.323146 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4c3ea295-c45f-4caa-bef0-11442a85452c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:35.329724 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4c3ea295-c45f-4caa-bef0-11442a85452c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:35.330309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4c3ea295-c45f-4caa-bef0-11442a85452c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:35.332701 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4c3ea295-c45f-4caa-bef0-11442a85452c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:35.333523 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4c3ea295-c45f-4caa-bef0-11442a85452c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:35.334130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4c3ea295-c45f-4caa-bef0-11442a85452c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:35.334740 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4c3ea295-c45f-4caa-bef0-11442a85452c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:35.487433 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4c3ea295-c45f-4caa-bef0-11442a85452c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:35.496666 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4c3ea295-c45f-4caa-bef0-11442a85452c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1509 microversion: 2.1 time: 0.177726 Oct 14 13:01:35.497174 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 95/194] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:35 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:01:35.703522 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1d09896e-9e79-4970-a095-bde7769e3e9c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "POST /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.428965 Oct 14 13:01:35.704160 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 100/195] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Oct 14 13:01:35 2022] POST /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:01:35.992781 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-07451456-4051-4889-9b59-327eed58b576 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:35.993388 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-07451456-4051-4889-9b59-327eed58b576 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:35.999554 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07451456-4051-4889-9b59-327eed58b576 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:36.000033 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07451456-4051-4889-9b59-327eed58b576 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:36.000457 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07451456-4051-4889-9b59-327eed58b576 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:36.001143 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07451456-4051-4889-9b59-327eed58b576 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:36.001616 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07451456-4051-4889-9b59-327eed58b576 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:36.002035 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07451456-4051-4889-9b59-327eed58b576 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:36.076102 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-07451456-4051-4889-9b59-327eed58b576 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:36.087484 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-07451456-4051-4889-9b59-327eed58b576 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1266 microversion: 2.1 time: 0.097197 Oct 14 13:01:36.088223 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 96/196] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:35 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:36.523688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-da354a76-54a2-4eca-9b56-90f1fce6a4f3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:36.524887 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-da354a76-54a2-4eca-9b56-90f1fce6a4f3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:36.532157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-da354a76-54a2-4eca-9b56-90f1fce6a4f3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:36.533616 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-da354a76-54a2-4eca-9b56-90f1fce6a4f3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:36.534580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-da354a76-54a2-4eca-9b56-90f1fce6a4f3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:36.535580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-da354a76-54a2-4eca-9b56-90f1fce6a4f3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:36.536275 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-da354a76-54a2-4eca-9b56-90f1fce6a4f3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:36.536803 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-da354a76-54a2-4eca-9b56-90f1fce6a4f3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:36.732291 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-da354a76-54a2-4eca-9b56-90f1fce6a4f3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:36.742731 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-da354a76-54a2-4eca-9b56-90f1fce6a4f3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1515 microversion: 2.1 time: 0.224732 Oct 14 13:01:36.743667 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 101/197] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:36 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:37.113675 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-81c1e9f6-c236-458c-841e-574e9653f96b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:37.113675 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-81c1e9f6-c236-458c-841e-574e9653f96b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:37.123468 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-81c1e9f6-c236-458c-841e-574e9653f96b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:37.124839 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-81c1e9f6-c236-458c-841e-574e9653f96b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:37.126256 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-81c1e9f6-c236-458c-841e-574e9653f96b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:37.127062 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-81c1e9f6-c236-458c-841e-574e9653f96b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:37.129970 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-81c1e9f6-c236-458c-841e-574e9653f96b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:37.130451 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-81c1e9f6-c236-458c-841e-574e9653f96b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:37.213653 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-81c1e9f6-c236-458c-841e-574e9653f96b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:37.217887 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=100 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:37.223208 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-81c1e9f6-c236-458c-841e-574e9653f96b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1266 microversion: 2.1 time: 0.116756 Oct 14 13:01:37.224379 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 97/198] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:37 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:37.790189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e54cf74d-5aaa-491b-bf25-139e9c23d2d7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Action: 'create', calling method: .version_select at 0x7fbb81d01af0>, body: {"keypair": {"name": "tempest-keypair-1619541885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN2qoOawyk1LFntJFR4xparHtmRXnj3JwtefcSNlAa+7c9I4yoyKumgxlvZmw4pp4xaB56ksO36rvD/2BBVJMpUxQJ8oJYDPA9mFYRSPLtxtvFbAxgXUCoDWfwf5XXgmw=="}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:37.814048 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-e54cf74d-5aaa-491b-bf25-139e9c23d2d7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for project 6c0d083e8cef4333b9514d2256991647. Resources: {'key_pairs'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:01:37.820130 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-e54cf74d-5aaa-491b-bf25-139e9c23d2d7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for user 0bcbf6513b6a4df3b044fadfb7888d54 and project 6c0d083e8cef4333b9514d2256991647. Resources: {'key_pairs'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:01:37.849474 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e54cf74d-5aaa-491b-bf25-139e9c23d2d7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066041 Oct 14 13:01:37.863037 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 102/199] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Oct 14 13:01:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:01:38.212160 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-b87b6138-a7a8-4c3f-93b9-919d4b2d005a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Action: 'create', calling method: .version_select at 0x7fbb81c143a0>, body: {"keypair": {"name": "tempest-keypair-433833009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoQH8dAe1i2BzPqyZ/lqKzxqkSNRs3r3+463yQIsovB49sKDCQGeredOh5c4IWvpv0l1ml07hGgVFuGPa4rH3MvyQu3ok42aTEDBRqQqw6Y0hXh3xOWe22V5WCbg9QS4A=="}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:38.237039 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-b87b6138-a7a8-4c3f-93b9-919d4b2d005a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Getting quotas for project c160176d8c804b7793bae21c205c538c. Resources: {'key_pairs'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:01:38.247122 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b80d267d-2144-41f3-9d8b-99ce18d1e89b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:38.248056 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b80d267d-2144-41f3-9d8b-99ce18d1e89b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:38.260985 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-b87b6138-a7a8-4c3f-93b9-919d4b2d005a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Getting quotas for user 60860294eb284b8aa11edd42dca4ae8d and project c160176d8c804b7793bae21c205c538c. Resources: {'key_pairs'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:01:38.261954 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b80d267d-2144-41f3-9d8b-99ce18d1e89b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:38.264356 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b80d267d-2144-41f3-9d8b-99ce18d1e89b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:38.264704 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b80d267d-2144-41f3-9d8b-99ce18d1e89b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:38.272149 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b80d267d-2144-41f3-9d8b-99ce18d1e89b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:38.275722 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b80d267d-2144-41f3-9d8b-99ce18d1e89b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:38.276824 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b80d267d-2144-41f3-9d8b-99ce18d1e89b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:38.325089 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-b87b6138-a7a8-4c3f-93b9-919d4b2d005a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120494 Oct 14 13:01:38.327282 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 98/200] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Oct 14 13:01:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:01:38.438643 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b80d267d-2144-41f3-9d8b-99ce18d1e89b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:38.450236 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b80d267d-2144-41f3-9d8b-99ce18d1e89b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1272 microversion: 2.1 time: 0.207680 Oct 14 13:01:38.451004 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 103/201] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:38 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:39.482998 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-204aa198-489c-4013-9752-8ff8e9606bca tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:39.484869 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-204aa198-489c-4013-9752-8ff8e9606bca tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:39.498586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-204aa198-489c-4013-9752-8ff8e9606bca tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:39.499284 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-204aa198-489c-4013-9752-8ff8e9606bca tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:39.500020 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-204aa198-489c-4013-9752-8ff8e9606bca tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:39.501469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-204aa198-489c-4013-9752-8ff8e9606bca tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:39.504571 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-204aa198-489c-4013-9752-8ff8e9606bca tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:39.511972 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-204aa198-489c-4013-9752-8ff8e9606bca tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:40.304165 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-204aa198-489c-4013-9752-8ff8e9606bca tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:40.334611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-204aa198-489c-4013-9752-8ff8e9606bca tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1314 microversion: 2.1 time: 0.864017 Oct 14 13:01:40.335218 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 99/202] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:39 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1314 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:41.363208 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-66af6cca-c87c-42e9-a441-6ac32351e6b4 req-65657b7c-d319-4f4e-bb5c-900ff3fb416a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3201585e-b536-44fc-8029-72833127e6ce", "tag": "666bdb57-9d1e-45ce-becd-346af795aeb6"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:41.364168 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-b7d5c23c-ad48-48cd-86b1-d1630e7b1d3b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:41.368985 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-b7d5c23c-ad48-48cd-86b1-d1630e7b1d3b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:41.393158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b7d5c23c-ad48-48cd-86b1-d1630e7b1d3b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:41.395682 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b7d5c23c-ad48-48cd-86b1-d1630e7b1d3b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:41.397428 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b7d5c23c-ad48-48cd-86b1-d1630e7b1d3b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:41.404576 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b7d5c23c-ad48-48cd-86b1-d1630e7b1d3b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:41.408173 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b7d5c23c-ad48-48cd-86b1-d1630e7b1d3b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:41.410420 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b7d5c23c-ad48-48cd-86b1-d1630e7b1d3b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:41.416546 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-66af6cca-c87c-42e9-a441-6ac32351e6b4 req-65657b7c-d319-4f4e-bb5c-900ff3fb416a service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:41.417332 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-66af6cca-c87c-42e9-a441-6ac32351e6b4 req-65657b7c-d319-4f4e-bb5c-900ff3fb416a service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:41.418055 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-66af6cca-c87c-42e9-a441-6ac32351e6b4 req-65657b7c-d319-4f4e-bb5c-900ff3fb416a service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:41.653019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-66af6cca-c87c-42e9-a441-6ac32351e6b4 req-65657b7c-d319-4f4e-bb5c-900ff3fb416a service nova] Creating event network-changed:666bdb57-9d1e-45ce-becd-346af795aeb6 for instance 3201585e-b536-44fc-8029-72833127e6ce on hv-cinder-82099 Oct 14 13:01:41.659374 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-66af6cca-c87c-42e9-a441-6ac32351e6b4 req-65657b7c-d319-4f4e-bb5c-900ff3fb416a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315586 Oct 14 13:01:41.660188 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 104/203] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:01:41.666673 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1158836657", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "70bca7d9-a052-4048-8e74-16b14b95c03e"}], "security_groups": [{"name": "tempest-securitygroup--882197552"}], "key_name": "tempest-keypair-1619541885", "user_data": "}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:41.836077 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.network.neutron [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] validate_networks() for [('70bca7d9-a052-4048-8e74-16b14b95c03e', None, None, None, None, None)] {{(pid=118868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:01:41.977458 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-b7d5c23c-ad48-48cd-86b1-d1630e7b1d3b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:42.004840 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-b7d5c23c-ad48-48cd-86b1-d1630e7b1d3b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1314 microversion: 2.1 time: 0.646229 Oct 14 13:01:42.007094 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 100/204] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:41 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:42.218469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1578246456", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71d7f67c-efcc-4a77-8c43-10bba17af0b2"}], "security_groups": [{"name": "tempest-securitygroup--249550429"}], "key_name": "tempest-keypair-433833009", "user_data": "}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:42.437628 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.network.neutron [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] validate_networks() for [('71d7f67c-efcc-4a77-8c43-10bba17af0b2', None, None, None, None, None)] {{(pid=118869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:01:42.640326 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Flavor limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:01:42.642640 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Image limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:01:42.644526 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Flavor pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:01:42.647246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Image pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:01:42.648809 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:01:42.680490 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:42.682322 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:42.683119 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:42.684896 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:42.685615 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:42.686269 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:42.711307 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for project 6c0d083e8cef4333b9514d2256991647. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:01:42.716527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for user 0bcbf6513b6a4df3b044fadfb7888d54 and project 6c0d083e8cef4333b9514d2256991647. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:01:42.730932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Going to run 1 instances... {{(pid=118868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:01:42.733532 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:01:42.838348 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5c738182-17d0-4ca3-b628-704ab37681d6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.170477 Oct 14 13:01:42.840131 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 105/205] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:01:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 13:01:42.851956 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-09d7cd5f-e53c-49d3-8c3f-4fb9eec1780d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:42.853088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-09d7cd5f-e53c-49d3-8c3f-4fb9eec1780d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:42.925198 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-09d7cd5f-e53c-49d3-8c3f-4fb9eec1780d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:42.936893 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-09d7cd5f-e53c-49d3-8c3f-4fb9eec1780d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1242 microversion: 2.1 time: 0.086972 Oct 14 13:01:42.938070 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 106/206] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:42 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:43.035830 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-86275b1d-05bf-41b8-b280-5ff6c8b9f29b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:43.036457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-86275b1d-05bf-41b8-b280-5ff6c8b9f29b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:43.047296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-86275b1d-05bf-41b8-b280-5ff6c8b9f29b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:43.047791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-86275b1d-05bf-41b8-b280-5ff6c8b9f29b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:43.048224 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-86275b1d-05bf-41b8-b280-5ff6c8b9f29b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:43.048922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-86275b1d-05bf-41b8-b280-5ff6c8b9f29b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:43.049373 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-86275b1d-05bf-41b8-b280-5ff6c8b9f29b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:43.058014 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-86275b1d-05bf-41b8-b280-5ff6c8b9f29b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:43.396673 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-86275b1d-05bf-41b8-b280-5ff6c8b9f29b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:43.409713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-86275b1d-05bf-41b8-b280-5ff6c8b9f29b tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1314 microversion: 2.1 time: 0.378110 Oct 14 13:01:43.410553 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 107/207] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:43 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:01:43.435168 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Flavor limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:01:43.435672 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Image limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:01:43.435903 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Flavor pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:01:43.436478 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Image pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:01:43.437414 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:01:43.457991 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:43.460791 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:43.462921 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:43.463730 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:43.464162 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:43.464812 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:43.492665 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Getting quotas for project c160176d8c804b7793bae21c205c538c. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:01:43.498500 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Getting quotas for user 60860294eb284b8aa11edd42dca4ae8d and project c160176d8c804b7793bae21c205c538c. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:01:43.511067 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Going to run 1 instances... {{(pid=118869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:01:43.515665 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:01:43.597666 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-523eb1d1-5954-4aa7-abb9-20f40d0f265f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.384267 Oct 14 13:01:43.599506 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 101/208] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:01:42 2022] POST /compute/v2.1/servers => generated 408 bytes in 1387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 14 13:01:43.611522 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d66d2d67-625e-4ab3-8c58-92e6edc21d8e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:43.612408 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-d66d2d67-625e-4ab3-8c58-92e6edc21d8e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:43.722614 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-d66d2d67-625e-4ab3-8c58-92e6edc21d8e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:43.739531 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-d66d2d67-625e-4ab3-8c58-92e6edc21d8e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1245 microversion: 2.1 time: 0.128984 Oct 14 13:01:43.740181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 108/209] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:43 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1245 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:43.965540 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-9578b12d-af42-48de-b89a-5b12f74a97cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:43.966218 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-9578b12d-af42-48de-b89a-5b12f74a97cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:43.979836 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9578b12d-af42-48de-b89a-5b12f74a97cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:43.984147 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9578b12d-af42-48de-b89a-5b12f74a97cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:43.984896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9578b12d-af42-48de-b89a-5b12f74a97cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:43.985679 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9578b12d-af42-48de-b89a-5b12f74a97cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:43.986137 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9578b12d-af42-48de-b89a-5b12f74a97cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:43.991557 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9578b12d-af42-48de-b89a-5b12f74a97cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:44.187891 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-9578b12d-af42-48de-b89a-5b12f74a97cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:44.202850 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-9578b12d-af42-48de-b89a-5b12f74a97cd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1246 microversion: 2.1 time: 0.241074 Oct 14 13:01:44.205980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 102/210] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:43 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1246 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:44.444519 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ba166394-f7a4-49a7-b747-45d0d37bfd63 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:44.445995 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-ba166394-f7a4-49a7-b747-45d0d37bfd63 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:44.463722 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba166394-f7a4-49a7-b747-45d0d37bfd63 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:44.468117 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba166394-f7a4-49a7-b747-45d0d37bfd63 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:44.468829 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba166394-f7a4-49a7-b747-45d0d37bfd63 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:44.475722 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba166394-f7a4-49a7-b747-45d0d37bfd63 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:44.476533 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba166394-f7a4-49a7-b747-45d0d37bfd63 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:44.477977 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba166394-f7a4-49a7-b747-45d0d37bfd63 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:44.715049 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ba166394-f7a4-49a7-b747-45d0d37bfd63 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:44.723547 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ba166394-f7a4-49a7-b747-45d0d37bfd63 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1314 microversion: 2.1 time: 0.292039 Oct 14 13:01:44.734437 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 109/211] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:44 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:44.766383 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2f57f117-3ad9-418e-91b1-8900e3beab9e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:44.767703 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-2f57f117-3ad9-418e-91b1-8900e3beab9e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:44.774548 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2f57f117-3ad9-418e-91b1-8900e3beab9e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:44.775361 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2f57f117-3ad9-418e-91b1-8900e3beab9e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:44.776014 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2f57f117-3ad9-418e-91b1-8900e3beab9e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:44.776933 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2f57f117-3ad9-418e-91b1-8900e3beab9e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:44.777632 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2f57f117-3ad9-418e-91b1-8900e3beab9e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:44.778269 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2f57f117-3ad9-418e-91b1-8900e3beab9e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:44.849042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-2f57f117-3ad9-418e-91b1-8900e3beab9e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:44.856967 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-2f57f117-3ad9-418e-91b1-8900e3beab9e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1241 microversion: 2.1 time: 0.094366 Oct 14 13:01:44.858204 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 103/212] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:44 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:45.230914 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1795fb2b-eab8-46ca-b031-56008346316d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:45.231609 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1795fb2b-eab8-46ca-b031-56008346316d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:45.233855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:45.241986 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1795fb2b-eab8-46ca-b031-56008346316d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:45.243504 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1795fb2b-eab8-46ca-b031-56008346316d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:45.244081 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1795fb2b-eab8-46ca-b031-56008346316d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:45.244943 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1795fb2b-eab8-46ca-b031-56008346316d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:45.245393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1795fb2b-eab8-46ca-b031-56008346316d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:45.246067 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1795fb2b-eab8-46ca-b031-56008346316d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:45.324437 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-1795fb2b-eab8-46ca-b031-56008346316d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:45.333880 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1795fb2b-eab8-46ca-b031-56008346316d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1238 microversion: 2.1 time: 0.109753 Oct 14 13:01:45.336613 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 110/213] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:45 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1238 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:45.738363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-13c9ebb0-825f-4e1a-b846-e12c14e1507f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:45.748115 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-13c9ebb0-825f-4e1a-b846-e12c14e1507f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:45.748731 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-13c9ebb0-825f-4e1a-b846-e12c14e1507f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:45.749050 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-13c9ebb0-825f-4e1a-b846-e12c14e1507f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:45.749940 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-246fc835-c924-4984-aa9c-142f589ef7a0 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:45.751235 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-246fc835-c924-4984-aa9c-142f589ef7a0 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:45.758577 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-246fc835-c924-4984-aa9c-142f589ef7a0 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:45.759314 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-246fc835-c924-4984-aa9c-142f589ef7a0 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:45.760410 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-246fc835-c924-4984-aa9c-142f589ef7a0 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:45.761314 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-246fc835-c924-4984-aa9c-142f589ef7a0 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:45.762107 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-246fc835-c924-4984-aa9c-142f589ef7a0 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:45.762723 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-246fc835-c924-4984-aa9c-142f589ef7a0 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:45.895573 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-13c9ebb0-825f-4e1a-b846-e12c14e1507f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Going to try to stop instance {{(pid=118869) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 14 13:01:45.970872 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-13c9ebb0-825f-4e1a-b846-e12c14e1507f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "POST /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/action" status: 202 len: 0 microversion: 2.1 time: 0.235411 Oct 14 13:01:45.971498 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 104/214] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Oct 14 13:01:45 2022] POST /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:01:46.000883 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-246fc835-c924-4984-aa9c-142f589ef7a0 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:46.003475 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7e75fcfe-3366-4815-ba98-fb0a500a7073 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:46.008710 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7e75fcfe-3366-4815-ba98-fb0a500a7073 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:46.011297 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-246fc835-c924-4984-aa9c-142f589ef7a0 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1314 microversion: 2.1 time: 0.266331 Oct 14 13:01:46.012363 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 111/215] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:45 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:46.018578 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7e75fcfe-3366-4815-ba98-fb0a500a7073 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:46.019252 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7e75fcfe-3366-4815-ba98-fb0a500a7073 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:46.019875 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7e75fcfe-3366-4815-ba98-fb0a500a7073 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:46.020573 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7e75fcfe-3366-4815-ba98-fb0a500a7073 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:46.021020 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7e75fcfe-3366-4815-ba98-fb0a500a7073 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:46.021434 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7e75fcfe-3366-4815-ba98-fb0a500a7073 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:46.031718 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7db7d6d6-fe38-4e7b-8461-9dd398c456c6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:46.032323 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-7db7d6d6-fe38-4e7b-8461-9dd398c456c6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:46.048534 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7db7d6d6-fe38-4e7b-8461-9dd398c456c6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:46.049023 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7db7d6d6-fe38-4e7b-8461-9dd398c456c6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:46.049452 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7db7d6d6-fe38-4e7b-8461-9dd398c456c6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:46.050614 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7db7d6d6-fe38-4e7b-8461-9dd398c456c6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:46.050614 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7db7d6d6-fe38-4e7b-8461-9dd398c456c6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:46.051033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7db7d6d6-fe38-4e7b-8461-9dd398c456c6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:46.142636 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7e75fcfe-3366-4815-ba98-fb0a500a7073 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:46.155667 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7e75fcfe-3366-4815-ba98-fb0a500a7073 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1241 microversion: 2.1 time: 0.180453 Oct 14 13:01:46.157430 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 105/216] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:45 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1241 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:46.209044 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-7db7d6d6-fe38-4e7b-8461-9dd398c456c6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:46.218406 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7db7d6d6-fe38-4e7b-8461-9dd398c456c6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1722 microversion: 2.1 time: 0.204686 Oct 14 13:01:46.219147 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 112/217] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:46 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:46.364904 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0f9de150-d49a-4c62-808a-4d81dd9111a3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:46.366188 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-0f9de150-d49a-4c62-808a-4d81dd9111a3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:46.374968 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0f9de150-d49a-4c62-808a-4d81dd9111a3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:46.375825 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0f9de150-d49a-4c62-808a-4d81dd9111a3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:46.376640 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0f9de150-d49a-4c62-808a-4d81dd9111a3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:46.377791 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0f9de150-d49a-4c62-808a-4d81dd9111a3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:46.378516 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0f9de150-d49a-4c62-808a-4d81dd9111a3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:46.379306 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0f9de150-d49a-4c62-808a-4d81dd9111a3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:46.477119 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-0f9de150-d49a-4c62-808a-4d81dd9111a3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:46.489057 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-0f9de150-d49a-4c62-808a-4d81dd9111a3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1294 microversion: 2.1 time: 0.131608 Oct 14 13:01:46.491150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 106/218] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:46 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1294 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:47.034778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-fa2bd251-8654-4994-b5f3-b9c032cf2899 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:47.035377 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-fa2bd251-8654-4994-b5f3-b9c032cf2899 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:47.051644 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fa2bd251-8654-4994-b5f3-b9c032cf2899 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:47.052483 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fa2bd251-8654-4994-b5f3-b9c032cf2899 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:47.057132 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fa2bd251-8654-4994-b5f3-b9c032cf2899 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:47.059395 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fa2bd251-8654-4994-b5f3-b9c032cf2899 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:47.060026 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fa2bd251-8654-4994-b5f3-b9c032cf2899 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:47.060861 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fa2bd251-8654-4994-b5f3-b9c032cf2899 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:47.180323 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-1d9c5e56-9321-4dd7-9372-91b18c9d709c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:47.181260 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-1d9c5e56-9321-4dd7-9372-91b18c9d709c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:47.192480 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1d9c5e56-9321-4dd7-9372-91b18c9d709c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:47.193827 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1d9c5e56-9321-4dd7-9372-91b18c9d709c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:47.194277 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1d9c5e56-9321-4dd7-9372-91b18c9d709c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:47.195084 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1d9c5e56-9321-4dd7-9372-91b18c9d709c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:47.195547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1d9c5e56-9321-4dd7-9372-91b18c9d709c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:47.195975 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1d9c5e56-9321-4dd7-9372-91b18c9d709c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:47.441787 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-1d9c5e56-9321-4dd7-9372-91b18c9d709c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:47.461629 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-1d9c5e56-9321-4dd7-9372-91b18c9d709c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1297 microversion: 2.1 time: 0.285948 Oct 14 13:01:47.478318 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 107/219] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:47 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1297 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:01:47.520236 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d0288635-6ae9-4a33-afff-904aed959486 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:47.521699 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-d0288635-6ae9-4a33-afff-904aed959486 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:47.535598 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d0288635-6ae9-4a33-afff-904aed959486 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:47.536349 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d0288635-6ae9-4a33-afff-904aed959486 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:47.536929 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d0288635-6ae9-4a33-afff-904aed959486 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:47.537838 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d0288635-6ae9-4a33-afff-904aed959486 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:47.538996 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d0288635-6ae9-4a33-afff-904aed959486 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:47.539708 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d0288635-6ae9-4a33-afff-904aed959486 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:47.593546 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-fa2bd251-8654-4994-b5f3-b9c032cf2899 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:47.605322 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-fa2bd251-8654-4994-b5f3-b9c032cf2899 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1314 microversion: 2.1 time: 0.574502 Oct 14 13:01:47.606300 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 113/220] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:47 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:47.617880 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e71365ce-a8c5-4b31-b653-ba6b936cf5a4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:47.626518 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e71365ce-a8c5-4b31-b653-ba6b936cf5a4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:47.636798 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e71365ce-a8c5-4b31-b653-ba6b936cf5a4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:47.641209 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e71365ce-a8c5-4b31-b653-ba6b936cf5a4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:47.641921 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e71365ce-a8c5-4b31-b653-ba6b936cf5a4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:47.645208 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e71365ce-a8c5-4b31-b653-ba6b936cf5a4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:47.645944 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e71365ce-a8c5-4b31-b653-ba6b936cf5a4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:47.650141 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e71365ce-a8c5-4b31-b653-ba6b936cf5a4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:48.002159 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e71365ce-a8c5-4b31-b653-ba6b936cf5a4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:48.016146 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e71365ce-a8c5-4b31-b653-ba6b936cf5a4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1300 microversion: 2.1 time: 0.408740 Oct 14 13:01:48.016739 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 114/221] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:47 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1300 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:48.424626 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-d0288635-6ae9-4a33-afff-904aed959486 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:48.439530 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-d0288635-6ae9-4a33-afff-904aed959486 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1722 microversion: 2.1 time: 0.956697 Oct 14 13:01:48.440138 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 108/222] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:47 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1722 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:48.491188 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e4b1a9bf-8bd1-4d29-9ba3-0e8ac23f75d3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:48.493625 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e4b1a9bf-8bd1-4d29-9ba3-0e8ac23f75d3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:48.510170 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e4b1a9bf-8bd1-4d29-9ba3-0e8ac23f75d3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:48.512272 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e4b1a9bf-8bd1-4d29-9ba3-0e8ac23f75d3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:48.514645 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e4b1a9bf-8bd1-4d29-9ba3-0e8ac23f75d3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:48.516943 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e4b1a9bf-8bd1-4d29-9ba3-0e8ac23f75d3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:48.519448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e4b1a9bf-8bd1-4d29-9ba3-0e8ac23f75d3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:48.520100 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e4b1a9bf-8bd1-4d29-9ba3-0e8ac23f75d3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:48.630934 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-02514d2f-bd65-497e-bacc-7c03273e4320 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:48.632055 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-02514d2f-bd65-497e-bacc-7c03273e4320 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:48.644898 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-02514d2f-bd65-497e-bacc-7c03273e4320 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:48.650464 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-02514d2f-bd65-497e-bacc-7c03273e4320 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:48.651252 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-02514d2f-bd65-497e-bacc-7c03273e4320 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:48.659016 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-02514d2f-bd65-497e-bacc-7c03273e4320 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:48.660509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-02514d2f-bd65-497e-bacc-7c03273e4320 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:48.661332 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-02514d2f-bd65-497e-bacc-7c03273e4320 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:48.731382 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e4b1a9bf-8bd1-4d29-9ba3-0e8ac23f75d3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:48.742656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e4b1a9bf-8bd1-4d29-9ba3-0e8ac23f75d3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1303 microversion: 2.1 time: 0.256494 Oct 14 13:01:48.750873 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 115/223] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:48 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1303 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:49.055911 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-36fb0d14-352d-42dc-970a-6518932c2c87 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:49.056907 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-36fb0d14-352d-42dc-970a-6518932c2c87 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:49.070871 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36fb0d14-352d-42dc-970a-6518932c2c87 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:49.072074 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36fb0d14-352d-42dc-970a-6518932c2c87 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:49.072668 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36fb0d14-352d-42dc-970a-6518932c2c87 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:49.073934 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36fb0d14-352d-42dc-970a-6518932c2c87 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:49.074956 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36fb0d14-352d-42dc-970a-6518932c2c87 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:49.075717 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36fb0d14-352d-42dc-970a-6518932c2c87 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:49.268976 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-02514d2f-bd65-497e-bacc-7c03273e4320 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:49.279582 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-02514d2f-bd65-497e-bacc-7c03273e4320 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1314 microversion: 2.1 time: 0.653201 Oct 14 13:01:49.280740 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 109/224] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:48 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1314 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:49.429845 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-36fb0d14-352d-42dc-970a-6518932c2c87 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:49.440962 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-36fb0d14-352d-42dc-970a-6518932c2c87 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1367 microversion: 2.1 time: 0.400153 Oct 14 13:01:49.442418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 116/225] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:49 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:49.467232 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0ab8b1c9-f559-4a16-b84f-0f8c27e96c58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:49.468348 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-0ab8b1c9-f559-4a16-b84f-0f8c27e96c58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:49.475261 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0ab8b1c9-f559-4a16-b84f-0f8c27e96c58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:49.476658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0ab8b1c9-f559-4a16-b84f-0f8c27e96c58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:49.477254 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0ab8b1c9-f559-4a16-b84f-0f8c27e96c58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:49.478203 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0ab8b1c9-f559-4a16-b84f-0f8c27e96c58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:49.478873 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0ab8b1c9-f559-4a16-b84f-0f8c27e96c58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:49.479478 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0ab8b1c9-f559-4a16-b84f-0f8c27e96c58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:49.776039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-3b5259f6-5934-44cb-a65e-99ff0c98a46a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:49.776651 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-3b5259f6-5934-44cb-a65e-99ff0c98a46a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:49.793995 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3b5259f6-5934-44cb-a65e-99ff0c98a46a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:49.794685 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3b5259f6-5934-44cb-a65e-99ff0c98a46a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:49.795216 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3b5259f6-5934-44cb-a65e-99ff0c98a46a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:49.796172 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3b5259f6-5934-44cb-a65e-99ff0c98a46a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:49.796787 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3b5259f6-5934-44cb-a65e-99ff0c98a46a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:49.797972 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3b5259f6-5934-44cb-a65e-99ff0c98a46a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:50.122212 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-0ab8b1c9-f559-4a16-b84f-0f8c27e96c58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:50.137972 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-0ab8b1c9-f559-4a16-b84f-0f8c27e96c58 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1722 microversion: 2.1 time: 0.674992 Oct 14 13:01:50.140690 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 110/226] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:49 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1722 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:50.154876 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-38236062-7916-4adb-8dc5-ca4b24c0cdef req-17d14914-28c0-4cd8-a6d5-d83eba56fc54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe0d2ae-312a-4c18-96d6-ae8d86372eee", "tag": "f683cd87-b2e8-44df-bb14-216087a69181"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:50.165006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3b5259f6-5934-44cb-a65e-99ff0c98a46a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:50.173559 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-3b5259f6-5934-44cb-a65e-99ff0c98a46a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1370 microversion: 2.1 time: 0.405076 Oct 14 13:01:50.174148 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 117/227] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:49 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1370 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:50.178953 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-38236062-7916-4adb-8dc5-ca4b24c0cdef req-17d14914-28c0-4cd8-a6d5-d83eba56fc54 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:50.182708 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-38236062-7916-4adb-8dc5-ca4b24c0cdef req-17d14914-28c0-4cd8-a6d5-d83eba56fc54 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:50.182840 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-38236062-7916-4adb-8dc5-ca4b24c0cdef req-17d14914-28c0-4cd8-a6d5-d83eba56fc54 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:50.196782 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-38236062-7916-4adb-8dc5-ca4b24c0cdef req-17d14914-28c0-4cd8-a6d5-d83eba56fc54 service nova] Creating event network-changed:f683cd87-b2e8-44df-bb14-216087a69181 for instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee on hv-cinder-82099 Oct 14 13:01:50.203931 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-38236062-7916-4adb-8dc5-ca4b24c0cdef req-17d14914-28c0-4cd8-a6d5-d83eba56fc54 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058891 Oct 14 13:01:50.206562 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 111/228] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:01:50.303782 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f70b6a95-d522-4182-91ce-cf05f8a602ef tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:50.305043 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-f70b6a95-d522-4182-91ce-cf05f8a602ef tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:50.321309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f70b6a95-d522-4182-91ce-cf05f8a602ef tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:50.322059 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f70b6a95-d522-4182-91ce-cf05f8a602ef tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:50.322684 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f70b6a95-d522-4182-91ce-cf05f8a602ef tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:50.323551 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f70b6a95-d522-4182-91ce-cf05f8a602ef tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:50.324171 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f70b6a95-d522-4182-91ce-cf05f8a602ef tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:50.324596 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f70b6a95-d522-4182-91ce-cf05f8a602ef tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:50.467097 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-64ba87ca-9759-4505-ac7c-69006493d3fd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:50.467942 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-64ba87ca-9759-4505-ac7c-69006493d3fd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:50.477899 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-64ba87ca-9759-4505-ac7c-69006493d3fd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:50.478511 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-64ba87ca-9759-4505-ac7c-69006493d3fd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:50.479035 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-64ba87ca-9759-4505-ac7c-69006493d3fd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:50.479904 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-64ba87ca-9759-4505-ac7c-69006493d3fd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:50.480947 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-64ba87ca-9759-4505-ac7c-69006493d3fd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:50.481725 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-64ba87ca-9759-4505-ac7c-69006493d3fd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:50.598760 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f70b6a95-d522-4182-91ce-cf05f8a602ef tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:50.602778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:50.611442 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f70b6a95-d522-4182-91ce-cf05f8a602ef tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1314 microversion: 2.1 time: 0.312165 Oct 14 13:01:50.612030 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 118/229] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:50 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:01:50.891218 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-64ba87ca-9759-4505-ac7c-69006493d3fd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:50.904436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-64ba87ca-9759-4505-ac7c-69006493d3fd tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1367 microversion: 2.1 time: 0.443690 Oct 14 13:01:50.905628 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 112/230] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:50 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1367 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:01:51.165289 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b336257f-2a01-42c5-8479-ef4064de9a98 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:51.165851 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b336257f-2a01-42c5-8479-ef4064de9a98 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:51.172875 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b336257f-2a01-42c5-8479-ef4064de9a98 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:51.173587 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b336257f-2a01-42c5-8479-ef4064de9a98 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:51.174178 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b336257f-2a01-42c5-8479-ef4064de9a98 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:51.175127 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b336257f-2a01-42c5-8479-ef4064de9a98 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:51.175739 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b336257f-2a01-42c5-8479-ef4064de9a98 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:51.176163 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b336257f-2a01-42c5-8479-ef4064de9a98 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:51.196874 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7321815d-4b88-451d-aea5-050dd061a02f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:51.197698 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7321815d-4b88-451d-aea5-050dd061a02f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:51.205427 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7321815d-4b88-451d-aea5-050dd061a02f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:51.206931 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7321815d-4b88-451d-aea5-050dd061a02f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:51.207593 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7321815d-4b88-451d-aea5-050dd061a02f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:51.208527 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7321815d-4b88-451d-aea5-050dd061a02f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:51.209188 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7321815d-4b88-451d-aea5-050dd061a02f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:51.209836 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7321815d-4b88-451d-aea5-050dd061a02f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:51.324499 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b336257f-2a01-42c5-8479-ef4064de9a98 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:51.335919 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b336257f-2a01-42c5-8479-ef4064de9a98 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1722 microversion: 2.1 time: 0.174164 Oct 14 13:01:51.336583 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 119/231] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:51 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:51.358835 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-ae33baba-2734-4d96-a0c2-75c017ffd6dd req-1210ad08-b539-4c6d-a8db-cc73e5d8ae72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3201585e-b536-44fc-8029-72833127e6ce", "name": "network-vif-plugged", "status": "completed", "tag": "666bdb57-9d1e-45ce-becd-346af795aeb6"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:51.368772 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-ae33baba-2734-4d96-a0c2-75c017ffd6dd req-1210ad08-b539-4c6d-a8db-cc73e5d8ae72 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:51.369290 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-ae33baba-2734-4d96-a0c2-75c017ffd6dd req-1210ad08-b539-4c6d-a8db-cc73e5d8ae72 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:51.369787 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-ae33baba-2734-4d96-a0c2-75c017ffd6dd req-1210ad08-b539-4c6d-a8db-cc73e5d8ae72 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:51.383114 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-ae33baba-2734-4d96-a0c2-75c017ffd6dd req-1210ad08-b539-4c6d-a8db-cc73e5d8ae72 service nova] Creating event network-vif-plugged:666bdb57-9d1e-45ce-becd-346af795aeb6 for instance 3201585e-b536-44fc-8029-72833127e6ce on hv-cinder-82099 Oct 14 13:01:51.388218 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-ae33baba-2734-4d96-a0c2-75c017ffd6dd req-1210ad08-b539-4c6d-a8db-cc73e5d8ae72 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032989 Oct 14 13:01:51.389172 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 120/232] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:01:51.531958 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7321815d-4b88-451d-aea5-050dd061a02f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:51.540911 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7321815d-4b88-451d-aea5-050dd061a02f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1370 microversion: 2.1 time: 0.348393 Oct 14 13:01:51.547642 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 113/233] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:51 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1370 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:01:51.635360 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f5dd118b-ca66-4267-b30a-08b8fc0a32fc tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:51.636386 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-f5dd118b-ca66-4267-b30a-08b8fc0a32fc tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:51.643684 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5dd118b-ca66-4267-b30a-08b8fc0a32fc tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:51.644351 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5dd118b-ca66-4267-b30a-08b8fc0a32fc tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:51.644987 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5dd118b-ca66-4267-b30a-08b8fc0a32fc tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:51.645899 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5dd118b-ca66-4267-b30a-08b8fc0a32fc tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:51.646462 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5dd118b-ca66-4267-b30a-08b8fc0a32fc tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:51.646989 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5dd118b-ca66-4267-b30a-08b8fc0a32fc tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:51.799043 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f5dd118b-ca66-4267-b30a-08b8fc0a32fc tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:51.811141 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f5dd118b-ca66-4267-b30a-08b8fc0a32fc tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1314 microversion: 2.1 time: 0.180896 Oct 14 13:01:51.826972 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 121/234] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:51 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:51.855687 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-ecda54e9-a015-47d2-b149-a1e0ef137f7c req-bf806f9c-32d2-4edc-b2b4-f9b3666db4db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1bf768-41b1-41c6-9621-d0aaead003e5", "tag": "7f90ffc6-2d72-4ce5-b0ce-2855a620d1c5"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:51.865774 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-ecda54e9-a015-47d2-b149-a1e0ef137f7c req-bf806f9c-32d2-4edc-b2b4-f9b3666db4db service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:51.867039 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-ecda54e9-a015-47d2-b149-a1e0ef137f7c req-bf806f9c-32d2-4edc-b2b4-f9b3666db4db service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:51.867551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-ecda54e9-a015-47d2-b149-a1e0ef137f7c req-bf806f9c-32d2-4edc-b2b4-f9b3666db4db service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:51.879630 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-ecda54e9-a015-47d2-b149-a1e0ef137f7c req-bf806f9c-32d2-4edc-b2b4-f9b3666db4db service nova] Creating event network-changed:7f90ffc6-2d72-4ce5-b0ce-2855a620d1c5 for instance ac1bf768-41b1-41c6-9621-d0aaead003e5 on hv-cinder-82099 Oct 14 13:01:51.885395 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-ecda54e9-a015-47d2-b149-a1e0ef137f7c req-bf806f9c-32d2-4edc-b2b4-f9b3666db4db service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035535 Oct 14 13:01:51.886708 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 114/235] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:01:51.927578 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-960506e3-eaf3-4c30-b945-86f71e7b5866 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:51.928491 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-960506e3-eaf3-4c30-b945-86f71e7b5866 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:51.935221 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-960506e3-eaf3-4c30-b945-86f71e7b5866 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:51.935922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-960506e3-eaf3-4c30-b945-86f71e7b5866 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:51.936506 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-960506e3-eaf3-4c30-b945-86f71e7b5866 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:51.937442 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-960506e3-eaf3-4c30-b945-86f71e7b5866 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:51.937925 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-960506e3-eaf3-4c30-b945-86f71e7b5866 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:51.938668 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-960506e3-eaf3-4c30-b945-86f71e7b5866 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:52.362576 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d1834d83-c5c5-40d1-a423-3e92276b8388 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:52.363301 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-d1834d83-c5c5-40d1-a423-3e92276b8388 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:52.373262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d1834d83-c5c5-40d1-a423-3e92276b8388 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:52.373805 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d1834d83-c5c5-40d1-a423-3e92276b8388 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:52.374255 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d1834d83-c5c5-40d1-a423-3e92276b8388 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:52.374969 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d1834d83-c5c5-40d1-a423-3e92276b8388 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:52.375423 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d1834d83-c5c5-40d1-a423-3e92276b8388 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:52.381642 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d1834d83-c5c5-40d1-a423-3e92276b8388 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:52.426227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-960506e3-eaf3-4c30-b945-86f71e7b5866 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:52.441431 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-960506e3-eaf3-4c30-b945-86f71e7b5866 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1367 microversion: 2.1 time: 0.518052 Oct 14 13:01:52.442506 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 122/236] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:51 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1367 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:52.564225 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-66caf370-872f-40b2-b22a-c5ebe2adca3f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:52.565020 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-66caf370-872f-40b2-b22a-c5ebe2adca3f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:52.571699 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-66caf370-872f-40b2-b22a-c5ebe2adca3f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:52.572384 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-66caf370-872f-40b2-b22a-c5ebe2adca3f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:52.573017 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-66caf370-872f-40b2-b22a-c5ebe2adca3f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:52.573763 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-66caf370-872f-40b2-b22a-c5ebe2adca3f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:52.574222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-66caf370-872f-40b2-b22a-c5ebe2adca3f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:52.574652 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-66caf370-872f-40b2-b22a-c5ebe2adca3f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:52.675128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-d1834d83-c5c5-40d1-a423-3e92276b8388 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:52.693060 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-d1834d83-c5c5-40d1-a423-3e92276b8388 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1722 microversion: 2.1 time: 0.334938 Oct 14 13:01:52.695447 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 115/237] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:52 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:52.702084 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=4 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:52.743183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-66caf370-872f-40b2-b22a-c5ebe2adca3f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:52.752494 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-66caf370-872f-40b2-b22a-c5ebe2adca3f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1370 microversion: 2.1 time: 0.192052 Oct 14 13:01:52.759232 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 123/238] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:52 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:01:52.836951 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-59205d61-3c28-4f10-9d7e-b16eafc62146 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:52.838133 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-59205d61-3c28-4f10-9d7e-b16eafc62146 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:52.844846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-59205d61-3c28-4f10-9d7e-b16eafc62146 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:52.845342 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-59205d61-3c28-4f10-9d7e-b16eafc62146 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:52.845832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-59205d61-3c28-4f10-9d7e-b16eafc62146 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:52.846544 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-59205d61-3c28-4f10-9d7e-b16eafc62146 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:52.846998 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-59205d61-3c28-4f10-9d7e-b16eafc62146 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:52.847422 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-59205d61-3c28-4f10-9d7e-b16eafc62146 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:52.870301 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:53.434547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-59205d61-3c28-4f10-9d7e-b16eafc62146 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:53.446411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-59205d61-3c28-4f10-9d7e-b16eafc62146 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1314 microversion: 2.1 time: 0.613988 Oct 14 13:01:53.447943 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 116/239] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:52 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:53.470016 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-98d54ab9-80a9-414f-96f4-f5ffd3c05358 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:53.470627 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-98d54ab9-80a9-414f-96f4-f5ffd3c05358 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:53.479025 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-98d54ab9-80a9-414f-96f4-f5ffd3c05358 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:53.479762 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-98d54ab9-80a9-414f-96f4-f5ffd3c05358 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:53.480405 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-98d54ab9-80a9-414f-96f4-f5ffd3c05358 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:53.481444 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-98d54ab9-80a9-414f-96f4-f5ffd3c05358 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:53.482098 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-98d54ab9-80a9-414f-96f4-f5ffd3c05358 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:53.482662 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-98d54ab9-80a9-414f-96f4-f5ffd3c05358 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:53.697094 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-98d54ab9-80a9-414f-96f4-f5ffd3c05358 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:53.715482 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-98d54ab9-80a9-414f-96f4-f5ffd3c05358 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1367 microversion: 2.1 time: 0.249636 Oct 14 13:01:53.716510 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 124/240] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:53 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:53.718458 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-6a44a7c0-9d9a-42f8-ac46-6edafd928681 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:53.719669 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-6a44a7c0-9d9a-42f8-ac46-6edafd928681 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:53.721830 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:53.722597 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=12 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:53.723310 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:53.730536 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6a44a7c0-9d9a-42f8-ac46-6edafd928681 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:53.732590 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6a44a7c0-9d9a-42f8-ac46-6edafd928681 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:53.733224 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6a44a7c0-9d9a-42f8-ac46-6edafd928681 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:53.734141 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6a44a7c0-9d9a-42f8-ac46-6edafd928681 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:53.735009 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6a44a7c0-9d9a-42f8-ac46-6edafd928681 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:53.735606 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6a44a7c0-9d9a-42f8-ac46-6edafd928681 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:53.779221 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-bed5af5b-b977-404b-89b4-f16f7acbad6e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:53.779846 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-bed5af5b-b977-404b-89b4-f16f7acbad6e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:53.781774 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=20 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:53.790768 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bed5af5b-b977-404b-89b4-f16f7acbad6e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:53.791269 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bed5af5b-b977-404b-89b4-f16f7acbad6e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:53.791708 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bed5af5b-b977-404b-89b4-f16f7acbad6e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:53.792425 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bed5af5b-b977-404b-89b4-f16f7acbad6e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:53.792878 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bed5af5b-b977-404b-89b4-f16f7acbad6e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:53.793715 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bed5af5b-b977-404b-89b4-f16f7acbad6e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:53.923238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-6a44a7c0-9d9a-42f8-ac46-6edafd928681 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:53.938114 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-6a44a7c0-9d9a-42f8-ac46-6edafd928681 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1722 microversion: 2.1 time: 0.223469 Oct 14 13:01:53.940029 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 117/241] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:53 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:53.976612 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-bed5af5b-b977-404b-89b4-f16f7acbad6e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:53.985593 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-bed5af5b-b977-404b-89b4-f16f7acbad6e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1370 microversion: 2.1 time: 0.213558 Oct 14 13:01:53.986549 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 125/242] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:53 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:01:54.186053 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2ddba5de-313f-4ac6-8666-74f4b555af0f tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Action: 'create', calling method: .version_select at 0x7fbb81d7a040>, body: {"keypair": {"name": "tempest-TestShelveInstance-540998058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNVvOi5x6ggnVVGt0PJAjN2QKCoQK9vUz/8aFsFUHJv7fQfj0/anQmq+728r1UzppGKE7bicJOr/uHe1XeoX0XfIBc0utP84qTr9Z/0yngUT/+9jNpJs5hmfm1rtQqrRQ=="}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:54.202182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-2ddba5de-313f-4ac6-8666-74f4b555af0f tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Getting quotas for project 97fa795966724ea89be8ac20675b589b. Resources: {'key_pairs'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:01:54.206331 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-2ddba5de-313f-4ac6-8666-74f4b555af0f tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Getting quotas for user accfa9fc356a4ccca7332118e8b9c421 and project 97fa795966724ea89be8ac20675b589b. Resources: {'key_pairs'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:01:54.228472 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-2ddba5de-313f-4ac6-8666-74f4b555af0f tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.213274 Oct 14 13:01:54.229067 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 118/243] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Oct 14 13:01:54 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:01:54.477992 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-00f77a85-c86c-4a16-9336-986fed27991d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:54.479233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-00f77a85-c86c-4a16-9336-986fed27991d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:54.485911 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-00f77a85-c86c-4a16-9336-986fed27991d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:54.486406 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-00f77a85-c86c-4a16-9336-986fed27991d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:54.486896 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-00f77a85-c86c-4a16-9336-986fed27991d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:54.487596 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-00f77a85-c86c-4a16-9336-986fed27991d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:54.488072 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-00f77a85-c86c-4a16-9336-986fed27991d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:54.488504 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-00f77a85-c86c-4a16-9336-986fed27991d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:54.691727 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-00f77a85-c86c-4a16-9336-986fed27991d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:54.701269 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-00f77a85-c86c-4a16-9336-986fed27991d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1463 microversion: 2.1 time: 0.227402 Oct 14 13:01:54.714054 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 126/244] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:54 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1463 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:54.743259 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-acb61834-3b7f-4d5a-b76e-ecb3e12352c9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:54.743259 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-acb61834-3b7f-4d5a-b76e-ecb3e12352c9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:54.753265 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-acb61834-3b7f-4d5a-b76e-ecb3e12352c9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:54.753784 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-acb61834-3b7f-4d5a-b76e-ecb3e12352c9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:54.758187 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-acb61834-3b7f-4d5a-b76e-ecb3e12352c9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:54.759487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-acb61834-3b7f-4d5a-b76e-ecb3e12352c9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:54.760711 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-acb61834-3b7f-4d5a-b76e-ecb3e12352c9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:54.761256 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-acb61834-3b7f-4d5a-b76e-ecb3e12352c9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:54.788931 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-556c3025-aec2-4ae0-85ae-6e8940ad1fe3 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:54.789630 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-556c3025-aec2-4ae0-85ae-6e8940ad1fe3 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:54.796205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-556c3025-aec2-4ae0-85ae-6e8940ad1fe3 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:54.796920 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-556c3025-aec2-4ae0-85ae-6e8940ad1fe3 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:54.797423 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-556c3025-aec2-4ae0-85ae-6e8940ad1fe3 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:54.798228 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-556c3025-aec2-4ae0-85ae-6e8940ad1fe3 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:54.798758 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-556c3025-aec2-4ae0-85ae-6e8940ad1fe3 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:54.799319 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-556c3025-aec2-4ae0-85ae-6e8940ad1fe3 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:54.840380 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-556c3025-aec2-4ae0-85ae-6e8940ad1fe3 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Going to try to terminate instance {{(pid=118868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:01:54.949985 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-556c3025-aec2-4ae0-85ae-6e8940ad1fe3 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 204 len: 0 microversion: 2.1 time: 0.165277 Oct 14 13:01:54.950681 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 127/245] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:01:54 2022] DELETE /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 14 13:01:54.959771 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-65515c4b-418f-4b4c-89af-cd559e1f5153 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:54.960526 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-65515c4b-418f-4b4c-89af-cd559e1f5153 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:54.966907 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-65515c4b-418f-4b4c-89af-cd559e1f5153 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:54.967403 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-65515c4b-418f-4b4c-89af-cd559e1f5153 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:54.967841 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-65515c4b-418f-4b4c-89af-cd559e1f5153 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:54.968548 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-65515c4b-418f-4b4c-89af-cd559e1f5153 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:54.969007 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-65515c4b-418f-4b4c-89af-cd559e1f5153 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:54.969431 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-65515c4b-418f-4b4c-89af-cd559e1f5153 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:54.985604 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-acb61834-3b7f-4d5a-b76e-ecb3e12352c9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:54.996447 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-acb61834-3b7f-4d5a-b76e-ecb3e12352c9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1367 microversion: 2.1 time: 0.260123 Oct 14 13:01:54.997059 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 119/246] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:54 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:55.011405 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-491821c4-36a9-44df-87de-c947f7d7d5cd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:55.012081 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-491821c4-36a9-44df-87de-c947f7d7d5cd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:55.026363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-491821c4-36a9-44df-87de-c947f7d7d5cd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:55.027148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-491821c4-36a9-44df-87de-c947f7d7d5cd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:55.027806 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-491821c4-36a9-44df-87de-c947f7d7d5cd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:55.028756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-491821c4-36a9-44df-87de-c947f7d7d5cd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:55.029417 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-491821c4-36a9-44df-87de-c947f7d7d5cd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:55.029991 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-491821c4-36a9-44df-87de-c947f7d7d5cd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:55.146290 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-65515c4b-418f-4b4c-89af-cd559e1f5153 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:55.156557 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-65515c4b-418f-4b4c-89af-cd559e1f5153 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1469 microversion: 2.1 time: 0.201118 Oct 14 13:01:55.157069 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 128/247] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:54 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1469 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:55.180276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c3823a24-13e4-4476-a395-1e49c85d02c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:55.181172 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c3823a24-13e4-4476-a395-1e49c85d02c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:55.187831 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c3823a24-13e4-4476-a395-1e49c85d02c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:55.188331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c3823a24-13e4-4476-a395-1e49c85d02c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:55.188772 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c3823a24-13e4-4476-a395-1e49c85d02c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:55.189471 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c3823a24-13e4-4476-a395-1e49c85d02c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:55.191663 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c3823a24-13e4-4476-a395-1e49c85d02c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:55.192276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c3823a24-13e4-4476-a395-1e49c85d02c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:55.232695 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-491821c4-36a9-44df-87de-c947f7d7d5cd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:55.247239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-491821c4-36a9-44df-87de-c947f7d7d5cd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1722 microversion: 2.1 time: 0.249060 Oct 14 13:01:55.250382 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 120/248] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:54 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:55.373404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c3823a24-13e4-4476-a395-1e49c85d02c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:55.383096 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c3823a24-13e4-4476-a395-1e49c85d02c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1370 microversion: 2.1 time: 0.215452 Oct 14 13:01:55.384173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 129/249] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:55 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:56.023948 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4a33487c-555a-49ae-9829-e59a72e2c391 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:56.025644 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4a33487c-555a-49ae-9829-e59a72e2c391 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:56.034445 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4a33487c-555a-49ae-9829-e59a72e2c391 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:56.035343 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4a33487c-555a-49ae-9829-e59a72e2c391 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:56.036136 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4a33487c-555a-49ae-9829-e59a72e2c391 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:56.037603 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4a33487c-555a-49ae-9829-e59a72e2c391 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:56.039141 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4a33487c-555a-49ae-9829-e59a72e2c391 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:56.040447 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4a33487c-555a-49ae-9829-e59a72e2c391 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:56.182085 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-73ec4153-c173-4876-a364-1c35b8aee167 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:56.182768 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-73ec4153-c173-4876-a364-1c35b8aee167 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:56.189725 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-73ec4153-c173-4876-a364-1c35b8aee167 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:56.190293 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-73ec4153-c173-4876-a364-1c35b8aee167 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:56.190799 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-73ec4153-c173-4876-a364-1c35b8aee167 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:56.191552 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-73ec4153-c173-4876-a364-1c35b8aee167 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:56.192119 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-73ec4153-c173-4876-a364-1c35b8aee167 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:56.192707 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-73ec4153-c173-4876-a364-1c35b8aee167 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:56.205805 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4a33487c-555a-49ae-9829-e59a72e2c391 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:56.215105 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4a33487c-555a-49ae-9829-e59a72e2c391 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1367 microversion: 2.1 time: 0.199539 Oct 14 13:01:56.216171 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 121/250] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:56 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:56.281008 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-15909f1f-148e-4e1c-a891-27c1ee3ff892 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:56.281834 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-15909f1f-148e-4e1c-a891-27c1ee3ff892 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:56.290141 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-15909f1f-148e-4e1c-a891-27c1ee3ff892 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:56.290956 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-15909f1f-148e-4e1c-a891-27c1ee3ff892 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:56.291549 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-15909f1f-148e-4e1c-a891-27c1ee3ff892 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:56.292317 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-15909f1f-148e-4e1c-a891-27c1ee3ff892 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:56.292867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-15909f1f-148e-4e1c-a891-27c1ee3ff892 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:56.293294 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-15909f1f-148e-4e1c-a891-27c1ee3ff892 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:56.360951 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-73ec4153-c173-4876-a364-1c35b8aee167 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:56.369711 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-73ec4153-c173-4876-a364-1c35b8aee167 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1469 microversion: 2.1 time: 0.191767 Oct 14 13:01:56.370416 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 130/251] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:56 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1469 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:01:56.408486 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-275360ef-450d-42d7-8bc9-45a5322abaec tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:56.409549 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-275360ef-450d-42d7-8bc9-45a5322abaec tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:56.418312 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-275360ef-450d-42d7-8bc9-45a5322abaec tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:56.418890 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-275360ef-450d-42d7-8bc9-45a5322abaec tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:56.419416 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-275360ef-450d-42d7-8bc9-45a5322abaec tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:56.426736 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-275360ef-450d-42d7-8bc9-45a5322abaec tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:56.428492 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-275360ef-450d-42d7-8bc9-45a5322abaec tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:56.430048 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-275360ef-450d-42d7-8bc9-45a5322abaec tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:56.446014 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-15909f1f-148e-4e1c-a891-27c1ee3ff892 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:56.457983 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-15909f1f-148e-4e1c-a891-27c1ee3ff892 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1722 microversion: 2.1 time: 0.182040 Oct 14 13:01:56.459133 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 122/252] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:56 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:01:56.596534 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-275360ef-450d-42d7-8bc9-45a5322abaec tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:56.604914 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-275360ef-450d-42d7-8bc9-45a5322abaec tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1370 microversion: 2.1 time: 0.201416 Oct 14 13:01:56.605566 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 131/253] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:56 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:01:57.073045 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-a9cd52e2-4f74-4d82-a5b6-e58bee66b228 req-f61bc096-22a4-4ee9-96ca-99557a1c7698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe0d2ae-312a-4c18-96d6-ae8d86372eee", "name": "network-vif-plugged", "status": "completed", "tag": "f683cd87-b2e8-44df-bb14-216087a69181"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:57.082621 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-a9cd52e2-4f74-4d82-a5b6-e58bee66b228 req-f61bc096-22a4-4ee9-96ca-99557a1c7698 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:57.083299 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-a9cd52e2-4f74-4d82-a5b6-e58bee66b228 req-f61bc096-22a4-4ee9-96ca-99557a1c7698 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:57.084011 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-a9cd52e2-4f74-4d82-a5b6-e58bee66b228 req-f61bc096-22a4-4ee9-96ca-99557a1c7698 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:57.101945 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-a9cd52e2-4f74-4d82-a5b6-e58bee66b228 req-f61bc096-22a4-4ee9-96ca-99557a1c7698 service nova] Creating event network-vif-plugged:f683cd87-b2e8-44df-bb14-216087a69181 for instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee on hv-cinder-82099 Oct 14 13:01:57.112495 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-a9cd52e2-4f74-4d82-a5b6-e58bee66b228 req-f61bc096-22a4-4ee9-96ca-99557a1c7698 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043669 Oct 14 13:01:57.113314 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 123/254] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:01:57.238567 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e35a78b7-74fa-4f52-9422-f159f96a74d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:57.239370 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e35a78b7-74fa-4f52-9422-f159f96a74d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:57.247921 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e35a78b7-74fa-4f52-9422-f159f96a74d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:57.248423 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e35a78b7-74fa-4f52-9422-f159f96a74d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:57.248861 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e35a78b7-74fa-4f52-9422-f159f96a74d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:57.249612 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e35a78b7-74fa-4f52-9422-f159f96a74d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:57.250075 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e35a78b7-74fa-4f52-9422-f159f96a74d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:57.250502 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e35a78b7-74fa-4f52-9422-f159f96a74d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:57.394320 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-91cfe8c1-4a8d-4420-995f-fe7a0fbaa4da tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:57.395019 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-91cfe8c1-4a8d-4420-995f-fe7a0fbaa4da tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:57.411739 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-91cfe8c1-4a8d-4420-995f-fe7a0fbaa4da tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:57.412452 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-91cfe8c1-4a8d-4420-995f-fe7a0fbaa4da tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:57.412948 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-91cfe8c1-4a8d-4420-995f-fe7a0fbaa4da tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:57.414314 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-91cfe8c1-4a8d-4420-995f-fe7a0fbaa4da tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:57.414811 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-91cfe8c1-4a8d-4420-995f-fe7a0fbaa4da tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:57.415240 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-91cfe8c1-4a8d-4420-995f-fe7a0fbaa4da tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:57.498215 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e35a78b7-74fa-4f52-9422-f159f96a74d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:57.511118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e35a78b7-74fa-4f52-9422-f159f96a74d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1367 microversion: 2.1 time: 0.276667 Oct 14 13:01:57.511808 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 132/255] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:57 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:57.518438 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-3974232e-a4ae-45d5-a636-dbc1ca97b637 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:57.519046 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-3974232e-a4ae-45d5-a636-dbc1ca97b637 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:57.534710 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3974232e-a4ae-45d5-a636-dbc1ca97b637 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:57.535536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3974232e-a4ae-45d5-a636-dbc1ca97b637 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:57.536133 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3974232e-a4ae-45d5-a636-dbc1ca97b637 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:57.537066 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3974232e-a4ae-45d5-a636-dbc1ca97b637 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:57.537714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3974232e-a4ae-45d5-a636-dbc1ca97b637 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:57.538343 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3974232e-a4ae-45d5-a636-dbc1ca97b637 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:57.650449 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-91cfe8c1-4a8d-4420-995f-fe7a0fbaa4da tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:57.658769 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-91cfe8c1-4a8d-4420-995f-fe7a0fbaa4da tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1469 microversion: 2.1 time: 0.268736 Oct 14 13:01:57.659979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 124/256] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:57 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1469 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:57.665392 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-3234f8a4-1497-45b8-a77f-104d779b02d7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:57.667738 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-3234f8a4-1497-45b8-a77f-104d779b02d7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:57.676611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3234f8a4-1497-45b8-a77f-104d779b02d7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:57.677437 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3234f8a4-1497-45b8-a77f-104d779b02d7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:57.677999 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3234f8a4-1497-45b8-a77f-104d779b02d7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:57.679305 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3234f8a4-1497-45b8-a77f-104d779b02d7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:57.679763 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3234f8a4-1497-45b8-a77f-104d779b02d7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:57.680197 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3234f8a4-1497-45b8-a77f-104d779b02d7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:57.843492 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-3234f8a4-1497-45b8-a77f-104d779b02d7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:57.853682 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-3234f8a4-1497-45b8-a77f-104d779b02d7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1370 microversion: 2.1 time: 0.192123 Oct 14 13:01:57.854251 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 125/257] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:57 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:57.859730 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3974232e-a4ae-45d5-a636-dbc1ca97b637 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:57.868900 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-3974232e-a4ae-45d5-a636-dbc1ca97b637 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1722 microversion: 2.1 time: 0.354170 Oct 14 13:01:57.869604 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 133/258] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:57 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1722 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:58.024786 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-5a15affd-e584-4695-ae8a-78b2c72c4c49 req-fe4f0679-965c-4572-9d16-817e2fc902d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3201585e-b536-44fc-8029-72833127e6ce", "name": "network-vif-deleted", "tag": "666bdb57-9d1e-45ce-becd-346af795aeb6"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:58.042397 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-5a15affd-e584-4695-ae8a-78b2c72c4c49 req-fe4f0679-965c-4572-9d16-817e2fc902d3 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:58.043280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-5a15affd-e584-4695-ae8a-78b2c72c4c49 req-fe4f0679-965c-4572-9d16-817e2fc902d3 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:58.043902 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-5a15affd-e584-4695-ae8a-78b2c72c4c49 req-fe4f0679-965c-4572-9d16-817e2fc902d3 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:58.057252 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-5a15affd-e584-4695-ae8a-78b2c72c4c49 req-fe4f0679-965c-4572-9d16-817e2fc902d3 service nova] Creating event network-vif-deleted:666bdb57-9d1e-45ce-becd-346af795aeb6 for instance 3201585e-b536-44fc-8029-72833127e6ce on hv-cinder-82099 Oct 14 13:01:58.063159 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-5a15affd-e584-4695-ae8a-78b2c72c4c49 req-fe4f0679-965c-4572-9d16-817e2fc902d3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042002 Oct 14 13:01:58.064194 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 126/259] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:01:58.533990 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-435e1a11-44ee-4871-a00b-df005f3a7011 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:58.534628 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-435e1a11-44ee-4871-a00b-df005f3a7011 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:58.541771 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-435e1a11-44ee-4871-a00b-df005f3a7011 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:58.542254 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-435e1a11-44ee-4871-a00b-df005f3a7011 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:58.542689 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-435e1a11-44ee-4871-a00b-df005f3a7011 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:58.543377 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-435e1a11-44ee-4871-a00b-df005f3a7011 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:58.543835 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-435e1a11-44ee-4871-a00b-df005f3a7011 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:58.544257 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-435e1a11-44ee-4871-a00b-df005f3a7011 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:58.562912 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:01:58.684975 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-20859f04-2c20-4613-a3ff-841218e8e29f tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:58.689960 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-435e1a11-44ee-4871-a00b-df005f3a7011 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:58.690984 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-20859f04-2c20-4613-a3ff-841218e8e29f tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:58.698133 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20859f04-2c20-4613-a3ff-841218e8e29f tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:58.698820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20859f04-2c20-4613-a3ff-841218e8e29f tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:58.699251 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20859f04-2c20-4613-a3ff-841218e8e29f tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:58.699946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20859f04-2c20-4613-a3ff-841218e8e29f tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:58.700407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20859f04-2c20-4613-a3ff-841218e8e29f tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:58.700810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20859f04-2c20-4613-a3ff-841218e8e29f tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:58.713397 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-435e1a11-44ee-4871-a00b-df005f3a7011 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1367 microversion: 2.1 time: 0.183181 Oct 14 13:01:58.715669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 134/260] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:58 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:58.752088 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20859f04-2c20-4613-a3ff-841218e8e29f tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:58.752572 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20859f04-2c20-4613-a3ff-841218e8e29f tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:58.753006 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-20859f04-2c20-4613-a3ff-841218e8e29f tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:58.753459 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-20859f04-2c20-4613-a3ff-841218e8e29f tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lazy-loading 'fault' on Instance uuid 3201585e-b536-44fc-8029-72833127e6ce {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:01:58.799504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-20859f04-2c20-4613-a3ff-841218e8e29f tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:58.809076 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-20859f04-2c20-4613-a3ff-841218e8e29f tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1304 microversion: 2.1 time: 0.130558 Oct 14 13:01:58.809680 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 127/261] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:58 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:58.876282 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-69ab620a-e68f-4388-bbec-b1ab7b6689f7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:58.877021 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-69ab620a-e68f-4388-bbec-b1ab7b6689f7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:58.883023 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-69ab620a-e68f-4388-bbec-b1ab7b6689f7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:58.883508 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-69ab620a-e68f-4388-bbec-b1ab7b6689f7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:58.883947 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-69ab620a-e68f-4388-bbec-b1ab7b6689f7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:58.884638 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-69ab620a-e68f-4388-bbec-b1ab7b6689f7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:58.885091 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-69ab620a-e68f-4388-bbec-b1ab7b6689f7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:58.885546 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-69ab620a-e68f-4388-bbec-b1ab7b6689f7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:58.893508 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ae004ccf-5325-4055-9530-7ef6b5eb069c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:58.894162 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ae004ccf-5325-4055-9530-7ef6b5eb069c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:58.902066 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ae004ccf-5325-4055-9530-7ef6b5eb069c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:58.902546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ae004ccf-5325-4055-9530-7ef6b5eb069c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:58.903174 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ae004ccf-5325-4055-9530-7ef6b5eb069c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:58.904018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ae004ccf-5325-4055-9530-7ef6b5eb069c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:58.904737 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ae004ccf-5325-4055-9530-7ef6b5eb069c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:58.905362 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ae004ccf-5325-4055-9530-7ef6b5eb069c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:59.026085 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-69ab620a-e68f-4388-bbec-b1ab7b6689f7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:59.033852 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-69ab620a-e68f-4388-bbec-b1ab7b6689f7 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1370 microversion: 2.1 time: 0.161451 Oct 14 13:01:59.034430 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 135/262] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:58 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:59.038316 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ae004ccf-5325-4055-9530-7ef6b5eb069c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:59.047596 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ae004ccf-5325-4055-9530-7ef6b5eb069c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1722 microversion: 2.1 time: 0.158555 Oct 14 13:01:59.048269 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 128/263] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:58 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:59.135438 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-ae6c6479-cc03-429f-b3ec-8ef2e0ee90f8 req-2a566889-549c-45e5-bfca-ff7c4925bcd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1bf768-41b1-41c6-9621-d0aaead003e5", "name": "network-vif-plugged", "status": "completed", "tag": "7f90ffc6-2d72-4ce5-b0ce-2855a620d1c5"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:01:59.144741 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-ae6c6479-cc03-429f-b3ec-8ef2e0ee90f8 req-2a566889-549c-45e5-bfca-ff7c4925bcd9 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:59.145205 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-ae6c6479-cc03-429f-b3ec-8ef2e0ee90f8 req-2a566889-549c-45e5-bfca-ff7c4925bcd9 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:59.145679 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-ae6c6479-cc03-429f-b3ec-8ef2e0ee90f8 req-2a566889-549c-45e5-bfca-ff7c4925bcd9 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:59.157550 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-ae6c6479-cc03-429f-b3ec-8ef2e0ee90f8 req-2a566889-549c-45e5-bfca-ff7c4925bcd9 service nova] Creating event network-vif-plugged:7f90ffc6-2d72-4ce5-b0ce-2855a620d1c5 for instance ac1bf768-41b1-41c6-9621-d0aaead003e5 on hv-cinder-82099 Oct 14 13:01:59.162566 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-ae6c6479-cc03-429f-b3ec-8ef2e0ee90f8 req-2a566889-549c-45e5-bfca-ff7c4925bcd9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031194 Oct 14 13:01:59.163408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 129/264] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:01:59.741863 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b5e10369-0d6c-42ed-8c1e-ca5f392cc1d7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:59.742479 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b5e10369-0d6c-42ed-8c1e-ca5f392cc1d7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:59.748887 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b5e10369-0d6c-42ed-8c1e-ca5f392cc1d7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:59.749294 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b5e10369-0d6c-42ed-8c1e-ca5f392cc1d7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:59.749762 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b5e10369-0d6c-42ed-8c1e-ca5f392cc1d7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:59.750445 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b5e10369-0d6c-42ed-8c1e-ca5f392cc1d7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:59.750896 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b5e10369-0d6c-42ed-8c1e-ca5f392cc1d7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:59.751314 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b5e10369-0d6c-42ed-8c1e-ca5f392cc1d7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:59.833132 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-bb38a892-abd6-44ec-a872-0132f1dc9f2d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:59.833893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-bb38a892-abd6-44ec-a872-0132f1dc9f2d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:59.840500 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bb38a892-abd6-44ec-a872-0132f1dc9f2d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:59.840990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bb38a892-abd6-44ec-a872-0132f1dc9f2d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:59.841436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bb38a892-abd6-44ec-a872-0132f1dc9f2d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:59.842158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bb38a892-abd6-44ec-a872-0132f1dc9f2d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:59.842612 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bb38a892-abd6-44ec-a872-0132f1dc9f2d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:59.843037 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bb38a892-abd6-44ec-a872-0132f1dc9f2d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:59.884628 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bb38a892-abd6-44ec-a872-0132f1dc9f2d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:59.885137 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bb38a892-abd6-44ec-a872-0132f1dc9f2d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:01:59.885840 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bb38a892-abd6-44ec-a872-0132f1dc9f2d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:01:59.886287 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-bb38a892-abd6-44ec-a872-0132f1dc9f2d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lazy-loading 'fault' on Instance uuid 3201585e-b536-44fc-8029-72833127e6ce {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:01:59.941691 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-bb38a892-abd6-44ec-a872-0132f1dc9f2d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdf8adbf99e640de8419efe9d8640b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '159e3573c405472baf7efac53e8a7b99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:59.953462 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b5e10369-0d6c-42ed-8c1e-ca5f392cc1d7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:01:59.964885 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-bb38a892-abd6-44ec-a872-0132f1dc9f2d tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 200 len: 1304 microversion: 2.1 time: 0.136264 Oct 14 13:01:59.965223 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b5e10369-0d6c-42ed-8c1e-ca5f392cc1d7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1556 microversion: 2.1 time: 0.227746 Oct 14 13:01:59.966004 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 130/265] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:59 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:01:59.966268 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 136/266] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:01:59 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1556 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:01:59.988836 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f99dc54c-33ff-47b2-8404-1636645e3f11 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:01:59.989243 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f99dc54c-33ff-47b2-8404-1636645e3f11 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:01:59.999395 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f99dc54c-33ff-47b2-8404-1636645e3f11 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:01:59.999802 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f99dc54c-33ff-47b2-8404-1636645e3f11 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:00.000420 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f99dc54c-33ff-47b2-8404-1636645e3f11 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:00.001282 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f99dc54c-33ff-47b2-8404-1636645e3f11 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:00.001916 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f99dc54c-33ff-47b2-8404-1636645e3f11 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:00.002483 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f99dc54c-33ff-47b2-8404-1636645e3f11 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:00.060956 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6943c42a-6cee-4223-8dd4-5e12145da07f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:00.061719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-6943c42a-6cee-4223-8dd4-5e12145da07f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:00.068987 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6943c42a-6cee-4223-8dd4-5e12145da07f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:00.070034 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6943c42a-6cee-4223-8dd4-5e12145da07f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:00.070480 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6943c42a-6cee-4223-8dd4-5e12145da07f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:00.071243 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6943c42a-6cee-4223-8dd4-5e12145da07f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:00.071700 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6943c42a-6cee-4223-8dd4-5e12145da07f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:00.072123 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6943c42a-6cee-4223-8dd4-5e12145da07f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:00.108042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-f99dc54c-33ff-47b2-8404-1636645e3f11 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123977 Oct 14 13:02:00.108874 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 131/267] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Oct 14 13:01:59 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:02:00.115174 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8ed1e4c6-22d4-4114-b305-30f9aefb85e3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:00.116352 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8ed1e4c6-22d4-4114-b305-30f9aefb85e3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:00.128466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ed1e4c6-22d4-4114-b305-30f9aefb85e3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:00.129064 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ed1e4c6-22d4-4114-b305-30f9aefb85e3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:00.129617 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ed1e4c6-22d4-4114-b305-30f9aefb85e3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:00.130421 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ed1e4c6-22d4-4114-b305-30f9aefb85e3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:00.130954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ed1e4c6-22d4-4114-b305-30f9aefb85e3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:00.131452 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ed1e4c6-22d4-4114-b305-30f9aefb85e3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:00.224084 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-6943c42a-6cee-4223-8dd4-5e12145da07f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:00.235547 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-6943c42a-6cee-4223-8dd4-5e12145da07f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1370 microversion: 2.1 time: 0.182871 Oct 14 13:02:00.236138 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 137/268] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:00 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:00.414869 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8ed1e4c6-22d4-4114-b305-30f9aefb85e3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:00.423152 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8ed1e4c6-22d4-4114-b305-30f9aefb85e3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1722 microversion: 2.1 time: 0.312693 Oct 14 13:02:00.423712 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 132/269] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:00 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:00.990753 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e42b4184-90d6-4da6-95fe-7c700d02c163 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:00.992043 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e42b4184-90d6-4da6-95fe-7c700d02c163 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] [instance: 3201585e-b536-44fc-8029-72833127e6ce] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:00.998642 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e42b4184-90d6-4da6-95fe-7c700d02c163 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:00.999358 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e42b4184-90d6-4da6-95fe-7c700d02c163 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:00.999794 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e42b4184-90d6-4da6-95fe-7c700d02c163 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:01.000819 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e42b4184-90d6-4da6-95fe-7c700d02c163 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:01.001498 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e42b4184-90d6-4da6-95fe-7c700d02c163 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:01.001937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e42b4184-90d6-4da6-95fe-7c700d02c163 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:01.018345 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-e42b4184-90d6-4da6-95fe-7c700d02c163 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] HTTP exception thrown: Instance 3201585e-b536-44fc-8029-72833127e6ce could not be found. Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e42b4184-90d6-4da6-95fe-7c700d02c163 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Request method failure captured: Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce HTTP/1.1 Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV2rf8Ie1uPIm1U4_z3B6aaUxOTe2pOWvtACFGDjVQ0eix6BStxS-VVb6v8JVYH6edJ7C3agzRHCHwJP-VB4ClMJSvraa5ELS6JpQaw7Jnc0J4UKGPP0xeHqRojcel7teZb6PCO7bbGF79nfL7ffe1BnNJddQIk0mNz9_A4IyppCWUQ Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 159e3573c405472baf7efac53e8a7b99 Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-VolumesNegativeTest-414114039 Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:02:01.020013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:02:01.021339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/159e3573c405472baf7efac53e8a7b99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/159e3573c405472baf7efac53e8a7b99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/159e3573c405472baf7efac53e8a7b99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_159e3573c405472baf7efac53e8a7b99", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:02:01.021339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-VolumesNegativeTest-414114039 Oct 14 13:02:01.021339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 159e3573c405472baf7efac53e8a7b99 Oct 14 13:02:01.021339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-VolumesNegativeTest-414114039 Oct 14 13:02:01.021339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-VolumesNegativeTest-414114039-project Oct 14 13:02:01.021339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:02:01.021339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:02:01.021339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: fdf8adbf99e640de8419efe9d8640b47 Oct 14 13:02:01.021339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-VolumesNegativeTest-414114039-project Oct 14 13:02:01.021339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:02:01.021339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance 3201585e-b536-44fc-8029-72833127e6ce could not be found. Oct 14 13:02:01.021339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '3201585e-b536-44fc-8029-72833127e6ce'} Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3201585e-b536-44fc-8029-72833127e6ce could not be found. Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:02:01.022057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3201585e-b536-44fc-8029-72833127e6ce could not be found. Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3201585e-b536-44fc-8029-72833127e6ce could not be found. Oct 14 13:02:01.023296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:02:01.024306 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e42b4184-90d6-4da6-95fe-7c700d02c163 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] Returning 404 to user: Instance 3201585e-b536-44fc-8029-72833127e6ce could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:02:01.024306 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e42b4184-90d6-4da6-95fe-7c700d02c163 tempest-VolumesNegativeTest-414114039 tempest-VolumesNegativeTest-414114039-project] 10.222.0.47 "GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce" status: 404 len: 111 microversion: 2.1 time: 0.034973 Oct 14 13:02:01.024306 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 138/270] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:00 2022] GET /compute/v2.1/servers/3201585e-b536-44fc-8029-72833127e6ce => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:02:01.170245 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-5aa30ab5-50b5-49d2-8bbb-d5f4429946b4 req-c946971e-dd65-4326-bcd0-7b6fe266bef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fe0d2ae-312a-4c18-96d6-ae8d86372eee", "tag": "f683cd87-b2e8-44df-bb14-216087a69181"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:02:01.180291 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-5aa30ab5-50b5-49d2-8bbb-d5f4429946b4 req-c946971e-dd65-4326-bcd0-7b6fe266bef6 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:01.181263 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-5aa30ab5-50b5-49d2-8bbb-d5f4429946b4 req-c946971e-dd65-4326-bcd0-7b6fe266bef6 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:01.181783 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-5aa30ab5-50b5-49d2-8bbb-d5f4429946b4 req-c946971e-dd65-4326-bcd0-7b6fe266bef6 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:01.195589 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-5aa30ab5-50b5-49d2-8bbb-d5f4429946b4 req-c946971e-dd65-4326-bcd0-7b6fe266bef6 service nova] Creating event network-changed:f683cd87-b2e8-44df-bb14-216087a69181 for instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee on hv-cinder-82099 Oct 14 13:02:01.200559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-5aa30ab5-50b5-49d2-8bbb-d5f4429946b4 req-c946971e-dd65-4326-bcd0-7b6fe266bef6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033981 Oct 14 13:02:01.201658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 133/271] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:02:01.261112 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0b9fcbb8-6dd6-48c1-9a1f-f3f0e40f4231 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:01.262939 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0b9fcbb8-6dd6-48c1-9a1f-f3f0e40f4231 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:01.270027 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0b9fcbb8-6dd6-48c1-9a1f-f3f0e40f4231 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:01.271348 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0b9fcbb8-6dd6-48c1-9a1f-f3f0e40f4231 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:01.272029 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0b9fcbb8-6dd6-48c1-9a1f-f3f0e40f4231 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:01.274043 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0b9fcbb8-6dd6-48c1-9a1f-f3f0e40f4231 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:01.275167 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0b9fcbb8-6dd6-48c1-9a1f-f3f0e40f4231 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:01.275811 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0b9fcbb8-6dd6-48c1-9a1f-f3f0e40f4231 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:01.448254 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-796bcfa3-72ef-4efe-80cf-04b927f39f33 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:01.449260 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-796bcfa3-72ef-4efe-80cf-04b927f39f33 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:01.456855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-796bcfa3-72ef-4efe-80cf-04b927f39f33 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:01.457760 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-796bcfa3-72ef-4efe-80cf-04b927f39f33 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:01.458495 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-796bcfa3-72ef-4efe-80cf-04b927f39f33 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:01.459514 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-796bcfa3-72ef-4efe-80cf-04b927f39f33 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:01.461531 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-796bcfa3-72ef-4efe-80cf-04b927f39f33 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:01.462305 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-796bcfa3-72ef-4efe-80cf-04b927f39f33 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:01.656297 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-796bcfa3-72ef-4efe-80cf-04b927f39f33 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:01.672162 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-796bcfa3-72ef-4efe-80cf-04b927f39f33 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1722 microversion: 2.1 time: 0.227546 Oct 14 13:02:01.672757 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 134/272] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:01 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:01.787496 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0b9fcbb8-6dd6-48c1-9a1f-f3f0e40f4231 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:01.796595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0b9fcbb8-6dd6-48c1-9a1f-f3f0e40f4231 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1370 microversion: 2.1 time: 0.540786 Oct 14 13:02:01.797298 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 139/273] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:01 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1370 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:01.967788 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ad1186dc-ad73-4a57-bafd-885f8d95edb5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:01.968956 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ad1186dc-ad73-4a57-bafd-885f8d95edb5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:01.975700 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ad1186dc-ad73-4a57-bafd-885f8d95edb5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:01.976430 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ad1186dc-ad73-4a57-bafd-885f8d95edb5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:01.976860 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ad1186dc-ad73-4a57-bafd-885f8d95edb5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:01.978015 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ad1186dc-ad73-4a57-bafd-885f8d95edb5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:01.978955 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ad1186dc-ad73-4a57-bafd-885f8d95edb5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:01.984637 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ad1186dc-ad73-4a57-bafd-885f8d95edb5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:02.036922 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ad1186dc-ad73-4a57-bafd-885f8d95edb5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/ips" status: 200 len: 153 microversion: 2.20 time: 0.074999 Oct 14 13:02:02.037568 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 135/274] 10.222.0.47 () {60 vars in 1289 bytes} [Fri Oct 14 13:02:01 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/ips => generated 153 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 13:02:02.697190 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5ea8c7a9-67ef-488f-9ed3-3e1338d07318 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:02.697848 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5ea8c7a9-67ef-488f-9ed3-3e1338d07318 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:02.704218 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ea8c7a9-67ef-488f-9ed3-3e1338d07318 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:02.704707 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ea8c7a9-67ef-488f-9ed3-3e1338d07318 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:02.705141 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ea8c7a9-67ef-488f-9ed3-3e1338d07318 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:02.705854 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ea8c7a9-67ef-488f-9ed3-3e1338d07318 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:02.706315 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ea8c7a9-67ef-488f-9ed3-3e1338d07318 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:02.706782 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ea8c7a9-67ef-488f-9ed3-3e1338d07318 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:02.823694 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-34e6a67a-3173-416c-8787-9b8a56d4745d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:02.824457 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-34e6a67a-3173-416c-8787-9b8a56d4745d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:02.831517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34e6a67a-3173-416c-8787-9b8a56d4745d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:02.832040 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34e6a67a-3173-416c-8787-9b8a56d4745d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:02.832469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34e6a67a-3173-416c-8787-9b8a56d4745d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:02.833364 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34e6a67a-3173-416c-8787-9b8a56d4745d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:02.834010 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34e6a67a-3173-416c-8787-9b8a56d4745d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:02.834613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34e6a67a-3173-416c-8787-9b8a56d4745d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:02.860818 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5ea8c7a9-67ef-488f-9ed3-3e1338d07318 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:02.870344 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5ea8c7a9-67ef-488f-9ed3-3e1338d07318 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1699 microversion: 2.1 time: 0.177040 Oct 14 13:02:02.871249 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 140/275] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:02 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1699 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:02.893960 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1f26f77c-0aef-483e-a38a-6a7a21d194e7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:02:02.900633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f26f77c-0aef-483e-a38a-6a7a21d194e7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:02.901132 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f26f77c-0aef-483e-a38a-6a7a21d194e7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:02.901606 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f26f77c-0aef-483e-a38a-6a7a21d194e7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:02.968084 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1f26f77c-0aef-483e-a38a-6a7a21d194e7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Going to try to start instance {{(pid=118868) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 14 13:02:03.014119 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-34e6a67a-3173-416c-8787-9b8a56d4745d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:03.018348 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=100 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:03.024980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-34e6a67a-3173-416c-8787-9b8a56d4745d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1563 microversion: 2.1 time: 0.206167 Oct 14 13:02:03.025854 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 136/276] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:02 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1563 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:02:03.037518 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1f26f77c-0aef-483e-a38a-6a7a21d194e7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "POST /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/action" status: 202 len: 0 microversion: 2.1 time: 0.147105 Oct 14 13:02:03.038717 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 141/277] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Oct 14 13:02:02 2022] POST /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 13:02:03.050702 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-bd38cef8-18a3-48c4-b7cb-795b1262bce1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:03.051240 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-bd38cef8-18a3-48c4-b7cb-795b1262bce1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:03.055997 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-74e43970-171d-474b-a941-05f8faa332da tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:03.056608 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-74e43970-171d-474b-a941-05f8faa332da tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:03.058417 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bd38cef8-18a3-48c4-b7cb-795b1262bce1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:03.059112 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bd38cef8-18a3-48c4-b7cb-795b1262bce1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:03.059553 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bd38cef8-18a3-48c4-b7cb-795b1262bce1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:03.060436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bd38cef8-18a3-48c4-b7cb-795b1262bce1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:03.060892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bd38cef8-18a3-48c4-b7cb-795b1262bce1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:03.061318 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bd38cef8-18a3-48c4-b7cb-795b1262bce1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:03.073107 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-74e43970-171d-474b-a941-05f8faa332da tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:03.073107 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-74e43970-171d-474b-a941-05f8faa332da tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:03.073557 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-74e43970-171d-474b-a941-05f8faa332da tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:03.074271 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-74e43970-171d-474b-a941-05f8faa332da tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:03.074725 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-74e43970-171d-474b-a941-05f8faa332da tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:03.075151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-74e43970-171d-474b-a941-05f8faa332da tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:03.204906 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-74e43970-171d-474b-a941-05f8faa332da tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154562 Oct 14 13:02:03.206465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 142/278] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Oct 14 13:02:03 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:02:03.276615 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-bd38cef8-18a3-48c4-b7cb-795b1262bce1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:03.290536 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-bd38cef8-18a3-48c4-b7cb-795b1262bce1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1708 microversion: 2.1 time: 0.243485 Oct 14 13:02:03.292733 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 137/279] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:03 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1708 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:04.317629 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b54ec83f-4dbe-4895-bfd6-1cd86d6fe830 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:04.318404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b54ec83f-4dbe-4895-bfd6-1cd86d6fe830 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:04.325255 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b54ec83f-4dbe-4895-bfd6-1cd86d6fe830 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:04.326051 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b54ec83f-4dbe-4895-bfd6-1cd86d6fe830 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:04.326484 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b54ec83f-4dbe-4895-bfd6-1cd86d6fe830 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:04.327302 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b54ec83f-4dbe-4895-bfd6-1cd86d6fe830 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:04.327956 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b54ec83f-4dbe-4895-bfd6-1cd86d6fe830 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:04.328591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b54ec83f-4dbe-4895-bfd6-1cd86d6fe830 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:04.504726 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b54ec83f-4dbe-4895-bfd6-1cd86d6fe830 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:04.514604 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b54ec83f-4dbe-4895-bfd6-1cd86d6fe830 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1708 microversion: 2.1 time: 0.204324 Oct 14 13:02:04.515861 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 143/280] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:04 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1708 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:04.540825 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-11a11ba2-8d81-4f30-80d6-d60760887080 req-7472931d-149f-47e2-934e-9ebbd3b1a1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1bf768-41b1-41c6-9621-d0aaead003e5", "tag": "7f90ffc6-2d72-4ce5-b0ce-2855a620d1c5"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:02:04.546046 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=4 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:04.554541 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-11a11ba2-8d81-4f30-80d6-d60760887080 req-7472931d-149f-47e2-934e-9ebbd3b1a1ca service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:04.555013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-11a11ba2-8d81-4f30-80d6-d60760887080 req-7472931d-149f-47e2-934e-9ebbd3b1a1ca service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:04.555609 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-11a11ba2-8d81-4f30-80d6-d60760887080 req-7472931d-149f-47e2-934e-9ebbd3b1a1ca service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:04.570354 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-11a11ba2-8d81-4f30-80d6-d60760887080 req-7472931d-149f-47e2-934e-9ebbd3b1a1ca service nova] Creating event network-changed:7f90ffc6-2d72-4ce5-b0ce-2855a620d1c5 for instance ac1bf768-41b1-41c6-9621-d0aaead003e5 on hv-cinder-82099 Oct 14 13:02:04.574867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-11a11ba2-8d81-4f30-80d6-d60760887080 req-7472931d-149f-47e2-934e-9ebbd3b1a1ca service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038149 Oct 14 13:02:04.575618 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 138/281] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:02:05.543908 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5e2a27bd-9de8-438c-9600-2ee755f241a9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:05.544527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5e2a27bd-9de8-438c-9600-2ee755f241a9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:05.550655 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e2a27bd-9de8-438c-9600-2ee755f241a9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:05.551135 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e2a27bd-9de8-438c-9600-2ee755f241a9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:05.551805 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e2a27bd-9de8-438c-9600-2ee755f241a9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:05.552501 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e2a27bd-9de8-438c-9600-2ee755f241a9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:05.552947 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e2a27bd-9de8-438c-9600-2ee755f241a9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:05.553424 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e2a27bd-9de8-438c-9600-2ee755f241a9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:05.767453 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-1b6b0b7c-de42-4f4d-a85f-8b6f92fa2614 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:02:05.769054 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-1b6b0b7c-de42-4f4d-a85f-8b6f92fa2614 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:05.777119 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1b6b0b7c-de42-4f4d-a85f-8b6f92fa2614 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:05.777876 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1b6b0b7c-de42-4f4d-a85f-8b6f92fa2614 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:05.778626 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1b6b0b7c-de42-4f4d-a85f-8b6f92fa2614 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:05.779505 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1b6b0b7c-de42-4f4d-a85f-8b6f92fa2614 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:05.780109 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1b6b0b7c-de42-4f4d-a85f-8b6f92fa2614 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:05.780693 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1b6b0b7c-de42-4f4d-a85f-8b6f92fa2614 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:05.800889 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5e2a27bd-9de8-438c-9600-2ee755f241a9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:05.813509 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5e2a27bd-9de8-438c-9600-2ee755f241a9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1712 microversion: 2.1 time: 0.273450 Oct 14 13:02:05.813970 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 144/282] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:05 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1712 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:05.822061 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-1b6b0b7c-de42-4f4d-a85f-8b6f92fa2614 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lazy-loading 'flavor' on Instance uuid f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:02:06.042142 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-1b6b0b7c-de42-4f4d-a85f-8b6f92fa2614 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "POST /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/action" status: 202 len: 0 microversion: 2.20 time: 0.278596 Oct 14 13:02:06.043241 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 139/283] 10.222.0.47 () {62 vars in 1319 bytes} [Fri Oct 14 13:02:05 2022] POST /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 14 13:02:06.051633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e886a828-7825-4873-b62b-13016d4a9ae0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:06.052466 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e886a828-7825-4873-b62b-13016d4a9ae0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:06.059721 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e886a828-7825-4873-b62b-13016d4a9ae0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:06.060220 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e886a828-7825-4873-b62b-13016d4a9ae0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:06.060656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e886a828-7825-4873-b62b-13016d4a9ae0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:06.061357 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e886a828-7825-4873-b62b-13016d4a9ae0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:06.062003 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e886a828-7825-4873-b62b-13016d4a9ae0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:06.062605 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e886a828-7825-4873-b62b-13016d4a9ae0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:06.217149 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e886a828-7825-4873-b62b-13016d4a9ae0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:06.227082 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e886a828-7825-4873-b62b-13016d4a9ae0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:06.229100 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e886a828-7825-4873-b62b-13016d4a9ae0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:06.230454 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e886a828-7825-4873-b62b-13016d4a9ae0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.182815 Oct 14 13:02:06.231363 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 145/284] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:06 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:07.259691 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a32683ca-2718-4e70-8f68-07cabeb15179 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:07.260294 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-a32683ca-2718-4e70-8f68-07cabeb15179 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:07.266833 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a32683ca-2718-4e70-8f68-07cabeb15179 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:07.267336 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a32683ca-2718-4e70-8f68-07cabeb15179 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:07.267791 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a32683ca-2718-4e70-8f68-07cabeb15179 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:07.268520 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a32683ca-2718-4e70-8f68-07cabeb15179 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:07.268967 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a32683ca-2718-4e70-8f68-07cabeb15179 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:07.269397 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a32683ca-2718-4e70-8f68-07cabeb15179 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:07.401256 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a32683ca-2718-4e70-8f68-07cabeb15179 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:07.409354 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a32683ca-2718-4e70-8f68-07cabeb15179 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:07.410868 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a32683ca-2718-4e70-8f68-07cabeb15179 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:07.412025 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-a32683ca-2718-4e70-8f68-07cabeb15179 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.157596 Oct 14 13:02:07.412583 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 140/285] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:07 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:08.439575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-25f3b7c7-a17f-41b6-93bd-76002a5934bc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:08.440189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-25f3b7c7-a17f-41b6-93bd-76002a5934bc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:08.447238 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25f3b7c7-a17f-41b6-93bd-76002a5934bc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:08.447726 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25f3b7c7-a17f-41b6-93bd-76002a5934bc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:08.448163 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25f3b7c7-a17f-41b6-93bd-76002a5934bc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:08.448854 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25f3b7c7-a17f-41b6-93bd-76002a5934bc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:08.449310 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25f3b7c7-a17f-41b6-93bd-76002a5934bc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:08.449766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25f3b7c7-a17f-41b6-93bd-76002a5934bc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:08.582366 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-25f3b7c7-a17f-41b6-93bd-76002a5934bc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:08.590336 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-25f3b7c7-a17f-41b6-93bd-76002a5934bc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:08.591796 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-25f3b7c7-a17f-41b6-93bd-76002a5934bc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:08.592989 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-25f3b7c7-a17f-41b6-93bd-76002a5934bc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.157463 Oct 14 13:02:08.593554 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 146/286] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:08 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:09.618762 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-475846f7-8b03-46e7-8b07-317ae49c58e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:09.619370 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-475846f7-8b03-46e7-8b07-317ae49c58e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:09.625400 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-475846f7-8b03-46e7-8b07-317ae49c58e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:09.625918 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-475846f7-8b03-46e7-8b07-317ae49c58e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:09.626350 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-475846f7-8b03-46e7-8b07-317ae49c58e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:09.627031 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-475846f7-8b03-46e7-8b07-317ae49c58e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:09.627479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-475846f7-8b03-46e7-8b07-317ae49c58e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:09.627906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-475846f7-8b03-46e7-8b07-317ae49c58e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:09.758007 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-475846f7-8b03-46e7-8b07-317ae49c58e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:09.766137 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-475846f7-8b03-46e7-8b07-317ae49c58e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:09.767598 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-475846f7-8b03-46e7-8b07-317ae49c58e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:09.768756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-475846f7-8b03-46e7-8b07-317ae49c58e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.154472 Oct 14 13:02:09.769304 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 141/287] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:09 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:10.793381 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d46ff696-2f83-449b-a893-074ef9817d81 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:10.794001 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-d46ff696-2f83-449b-a893-074ef9817d81 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:10.800439 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d46ff696-2f83-449b-a893-074ef9817d81 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:10.800920 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d46ff696-2f83-449b-a893-074ef9817d81 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:10.801355 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d46ff696-2f83-449b-a893-074ef9817d81 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:10.802063 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d46ff696-2f83-449b-a893-074ef9817d81 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:10.802518 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d46ff696-2f83-449b-a893-074ef9817d81 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:10.802941 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d46ff696-2f83-449b-a893-074ef9817d81 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:10.929619 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-d46ff696-2f83-449b-a893-074ef9817d81 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:10.937588 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-d46ff696-2f83-449b-a893-074ef9817d81 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:10.939041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-d46ff696-2f83-449b-a893-074ef9817d81 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:10.940231 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-d46ff696-2f83-449b-a893-074ef9817d81 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.150773 Oct 14 13:02:10.940776 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 147/288] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:10 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:11.965550 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e409efae-9f7f-40e6-8fb1-e32dc5321411 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:11.966150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e409efae-9f7f-40e6-8fb1-e32dc5321411 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:11.972242 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e409efae-9f7f-40e6-8fb1-e32dc5321411 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:11.972724 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e409efae-9f7f-40e6-8fb1-e32dc5321411 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:11.973157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e409efae-9f7f-40e6-8fb1-e32dc5321411 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:11.973957 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e409efae-9f7f-40e6-8fb1-e32dc5321411 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:11.974337 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e409efae-9f7f-40e6-8fb1-e32dc5321411 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:11.974765 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e409efae-9f7f-40e6-8fb1-e32dc5321411 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:12.104587 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e409efae-9f7f-40e6-8fb1-e32dc5321411 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:12.113173 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e409efae-9f7f-40e6-8fb1-e32dc5321411 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:12.114636 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e409efae-9f7f-40e6-8fb1-e32dc5321411 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:12.115778 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e409efae-9f7f-40e6-8fb1-e32dc5321411 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.154215 Oct 14 13:02:12.116326 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 142/289] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:11 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:13.140270 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5837edad-120e-4b4e-930b-9990980f218a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:13.140964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5837edad-120e-4b4e-930b-9990980f218a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:13.141124 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-691971120", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-540998058", "security_groups": [{"name": "tempest-secgroup-smoke-1597821430"}], "networks": [{"uuid": "fb13320f-34c8-4071-976b-aea523399720"}], "block_device_mapping_v2": [{"uuid": "4ad7f827-a9fc-43c1-95cc-2b21f484768b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:02:13.148256 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5837edad-120e-4b4e-930b-9990980f218a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:13.148812 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5837edad-120e-4b4e-930b-9990980f218a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:13.149327 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5837edad-120e-4b4e-930b-9990980f218a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:13.150105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5837edad-120e-4b4e-930b-9990980f218a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:13.150633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5837edad-120e-4b4e-930b-9990980f218a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:13.151152 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5837edad-120e-4b4e-930b-9990980f218a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:13.256787 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.network.neutron [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] validate_networks() for [('fb13320f-34c8-4071-976b-aea523399720', None, None, None, None, None)] {{(pid=118869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:02:13.288778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5837edad-120e-4b4e-930b-9990980f218a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:13.296799 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5837edad-120e-4b4e-930b-9990980f218a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:13.298321 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5837edad-120e-4b4e-930b-9990980f218a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:13.299483 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5837edad-120e-4b4e-930b-9990980f218a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.163246 Oct 14 13:02:13.300036 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 148/290] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:13 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:13.626068 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Flavor limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:02:13.626485 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Image limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:02:13.626948 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Flavor pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:02:13.627343 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Image pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:02:13.627743 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:02:13.636483 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:13.636952 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:13.637375 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:13.638117 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:13.638562 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:13.638977 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:13.655766 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Getting quotas for project 97fa795966724ea89be8ac20675b589b. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:02:13.660049 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Getting quotas for user accfa9fc356a4ccca7332118e8b9c421 and project 97fa795966724ea89be8ac20675b589b. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:02:13.716786 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Going to run 1 instances... {{(pid=118869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:02:13.718980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4ad7f827-a9fc-43c1-95cc-2b21f484768b',volume_size=None,volume_type=None)] {{(pid=118869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:02:13.846593 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7e265e73-dcf2-4c7c-a04a-4c27891039f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.709195 Oct 14 13:02:13.847226 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 143/291] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:02:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 14 13:02:13.858888 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b07221a8-6cee-4e49-9845-72fc0e85b726 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:13.859754 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b07221a8-6cee-4e49-9845-72fc0e85b726 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:13.912519 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b07221a8-6cee-4e49-9845-72fc0e85b726 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:13.919951 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b07221a8-6cee-4e49-9845-72fc0e85b726 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1087 microversion: 2.1 time: 0.064872 Oct 14 13:02:13.920533 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 149/292] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:13 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1087 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:14.325754 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-47757694-94dc-4ed3-994e-6f29d2892dff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:14.326548 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-47757694-94dc-4ed3-994e-6f29d2892dff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:14.333714 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-47757694-94dc-4ed3-994e-6f29d2892dff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:14.334195 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-47757694-94dc-4ed3-994e-6f29d2892dff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:14.335193 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-47757694-94dc-4ed3-994e-6f29d2892dff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:14.335883 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-47757694-94dc-4ed3-994e-6f29d2892dff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:14.336332 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-47757694-94dc-4ed3-994e-6f29d2892dff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:14.336751 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-47757694-94dc-4ed3-994e-6f29d2892dff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:14.475260 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-47757694-94dc-4ed3-994e-6f29d2892dff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:14.484142 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-47757694-94dc-4ed3-994e-6f29d2892dff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:14.485913 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-47757694-94dc-4ed3-994e-6f29d2892dff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:14.487080 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-47757694-94dc-4ed3-994e-6f29d2892dff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.165544 Oct 14 13:02:14.487640 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 144/293] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:14 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:14.942722 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-3b24c297-01e3-423f-83f6-f233611f626c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:14.943242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-3b24c297-01e3-423f-83f6-f233611f626c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:14.950941 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3b24c297-01e3-423f-83f6-f233611f626c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:14.951425 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3b24c297-01e3-423f-83f6-f233611f626c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:14.951858 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3b24c297-01e3-423f-83f6-f233611f626c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:14.952542 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3b24c297-01e3-423f-83f6-f233611f626c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:14.953004 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3b24c297-01e3-423f-83f6-f233611f626c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:14.953427 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3b24c297-01e3-423f-83f6-f233611f626c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:15.015053 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3b24c297-01e3-423f-83f6-f233611f626c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:15.023445 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-3b24c297-01e3-423f-83f6-f233611f626c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1185 microversion: 2.1 time: 0.084482 Oct 14 13:02:15.024107 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 150/294] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:14 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:15.512857 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ec7b9cd4-9bd3-43db-bb3a-45bf3eb48f36 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:15.513461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ec7b9cd4-9bd3-43db-bb3a-45bf3eb48f36 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:15.519379 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec7b9cd4-9bd3-43db-bb3a-45bf3eb48f36 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:15.519929 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec7b9cd4-9bd3-43db-bb3a-45bf3eb48f36 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:15.520359 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec7b9cd4-9bd3-43db-bb3a-45bf3eb48f36 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:15.521057 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec7b9cd4-9bd3-43db-bb3a-45bf3eb48f36 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:15.521617 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec7b9cd4-9bd3-43db-bb3a-45bf3eb48f36 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:15.522039 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec7b9cd4-9bd3-43db-bb3a-45bf3eb48f36 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:15.657351 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ec7b9cd4-9bd3-43db-bb3a-45bf3eb48f36 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:15.670062 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ec7b9cd4-9bd3-43db-bb3a-45bf3eb48f36 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:15.671905 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ec7b9cd4-9bd3-43db-bb3a-45bf3eb48f36 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:15.673083 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ec7b9cd4-9bd3-43db-bb3a-45bf3eb48f36 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.164203 Oct 14 13:02:15.673825 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 145/295] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:15 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:16.047193 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-cb7a7d7b-2c58-4961-82d3-7ace5da4ecb8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:16.047760 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-cb7a7d7b-2c58-4961-82d3-7ace5da4ecb8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:16.050173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:16.056015 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cb7a7d7b-2c58-4961-82d3-7ace5da4ecb8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:16.056504 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cb7a7d7b-2c58-4961-82d3-7ace5da4ecb8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:16.056942 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cb7a7d7b-2c58-4961-82d3-7ace5da4ecb8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:16.057677 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cb7a7d7b-2c58-4961-82d3-7ace5da4ecb8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:16.058141 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cb7a7d7b-2c58-4961-82d3-7ace5da4ecb8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:16.058569 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cb7a7d7b-2c58-4961-82d3-7ace5da4ecb8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:16.274714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-cb7a7d7b-2c58-4961-82d3-7ace5da4ecb8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:16.282469 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-cb7a7d7b-2c58-4961-82d3-7ace5da4ecb8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1259 microversion: 2.1 time: 0.239298 Oct 14 13:02:16.283040 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 151/296] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:16 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1259 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:02:16.540348 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-edbef687-217a-4e11-b157-3a3b99bd92be req-73444d59-4a4d-46f1-9cf0-5bbe35e01328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f", "tag": "5974c9e5-7b5e-4f03-aaed-db90e7d7a18e"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:02:16.551985 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-edbef687-217a-4e11-b157-3a3b99bd92be req-73444d59-4a4d-46f1-9cf0-5bbe35e01328 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:16.552555 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-edbef687-217a-4e11-b157-3a3b99bd92be req-73444d59-4a4d-46f1-9cf0-5bbe35e01328 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:16.553777 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-edbef687-217a-4e11-b157-3a3b99bd92be req-73444d59-4a4d-46f1-9cf0-5bbe35e01328 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:16.566699 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-edbef687-217a-4e11-b157-3a3b99bd92be req-73444d59-4a4d-46f1-9cf0-5bbe35e01328 service nova] Creating event network-changed:5974c9e5-7b5e-4f03-aaed-db90e7d7a18e for instance 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f on hv-cinder-82099 Oct 14 13:02:16.572918 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-edbef687-217a-4e11-b157-3a3b99bd92be req-73444d59-4a4d-46f1-9cf0-5bbe35e01328 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036590 Oct 14 13:02:16.573564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 146/297] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:02:16.700019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ff304c72-ecac-47c2-8532-ff305cd6c4ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:16.700676 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-ff304c72-ecac-47c2-8532-ff305cd6c4ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:16.706880 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ff304c72-ecac-47c2-8532-ff305cd6c4ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:16.707288 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ff304c72-ecac-47c2-8532-ff305cd6c4ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:16.707703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ff304c72-ecac-47c2-8532-ff305cd6c4ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:16.708397 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ff304c72-ecac-47c2-8532-ff305cd6c4ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:16.708848 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ff304c72-ecac-47c2-8532-ff305cd6c4ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:16.709910 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ff304c72-ecac-47c2-8532-ff305cd6c4ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:16.714030 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:16.926661 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ff304c72-ecac-47c2-8532-ff305cd6c4ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:16.935277 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ff304c72-ecac-47c2-8532-ff305cd6c4ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:16.936795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ff304c72-ecac-47c2-8532-ff305cd6c4ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:16.937993 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ff304c72-ecac-47c2-8532-ff305cd6c4ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.241889 Oct 14 13:02:16.938553 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 152/298] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:16 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:17.307707 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-32d920ff-2346-4f9f-80db-90ced0084cb5 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:17.308405 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-32d920ff-2346-4f9f-80db-90ced0084cb5 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:17.314663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-32d920ff-2346-4f9f-80db-90ced0084cb5 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:17.315145 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-32d920ff-2346-4f9f-80db-90ced0084cb5 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:17.315580 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-32d920ff-2346-4f9f-80db-90ced0084cb5 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:17.316262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-32d920ff-2346-4f9f-80db-90ced0084cb5 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:17.316714 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-32d920ff-2346-4f9f-80db-90ced0084cb5 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:17.317136 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-32d920ff-2346-4f9f-80db-90ced0084cb5 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:17.446140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-32d920ff-2346-4f9f-80db-90ced0084cb5 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:17.453998 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-32d920ff-2346-4f9f-80db-90ced0084cb5 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1259 microversion: 2.1 time: 0.151063 Oct 14 13:02:17.454571 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 147/299] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:17 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:17.963972 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b0eb58f7-ca62-4184-bb9c-ca7e9823f221 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:17.964615 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b0eb58f7-ca62-4184-bb9c-ca7e9823f221 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:17.970956 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b0eb58f7-ca62-4184-bb9c-ca7e9823f221 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:17.971469 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b0eb58f7-ca62-4184-bb9c-ca7e9823f221 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:17.971903 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b0eb58f7-ca62-4184-bb9c-ca7e9823f221 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:17.972582 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b0eb58f7-ca62-4184-bb9c-ca7e9823f221 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:17.973036 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b0eb58f7-ca62-4184-bb9c-ca7e9823f221 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:17.973459 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b0eb58f7-ca62-4184-bb9c-ca7e9823f221 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:18.099050 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b0eb58f7-ca62-4184-bb9c-ca7e9823f221 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:18.107798 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b0eb58f7-ca62-4184-bb9c-ca7e9823f221 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:18.109601 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b0eb58f7-ca62-4184-bb9c-ca7e9823f221 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:18.110956 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b0eb58f7-ca62-4184-bb9c-ca7e9823f221 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.150913 Oct 14 13:02:18.111513 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 153/300] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:17 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:18.477344 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7596b6c6-9498-4d28-bd6b-b0eb33beec19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:18.477945 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7596b6c6-9498-4d28-bd6b-b0eb33beec19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:18.484071 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7596b6c6-9498-4d28-bd6b-b0eb33beec19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:18.484807 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7596b6c6-9498-4d28-bd6b-b0eb33beec19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:18.485233 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7596b6c6-9498-4d28-bd6b-b0eb33beec19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:18.485945 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7596b6c6-9498-4d28-bd6b-b0eb33beec19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:18.486391 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7596b6c6-9498-4d28-bd6b-b0eb33beec19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:18.486808 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7596b6c6-9498-4d28-bd6b-b0eb33beec19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:18.621865 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7596b6c6-9498-4d28-bd6b-b0eb33beec19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:18.629407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7596b6c6-9498-4d28-bd6b-b0eb33beec19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1259 microversion: 2.1 time: 0.156667 Oct 14 13:02:18.629998 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 148/301] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:18 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:19.136791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-36aa513f-b69e-43f9-aa6b-8942c236afcb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:19.137433 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-36aa513f-b69e-43f9-aa6b-8942c236afcb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:19.143873 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36aa513f-b69e-43f9-aa6b-8942c236afcb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:19.144338 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36aa513f-b69e-43f9-aa6b-8942c236afcb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:19.144773 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36aa513f-b69e-43f9-aa6b-8942c236afcb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:19.145461 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36aa513f-b69e-43f9-aa6b-8942c236afcb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:19.145938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36aa513f-b69e-43f9-aa6b-8942c236afcb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:19.146362 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-36aa513f-b69e-43f9-aa6b-8942c236afcb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:19.275832 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-36aa513f-b69e-43f9-aa6b-8942c236afcb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:19.283961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-36aa513f-b69e-43f9-aa6b-8942c236afcb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:19.285423 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-36aa513f-b69e-43f9-aa6b-8942c236afcb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:19.286623 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-36aa513f-b69e-43f9-aa6b-8942c236afcb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.153834 Oct 14 13:02:19.287176 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 154/302] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:19 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:19.651711 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a50e1e57-2ea2-4892-ade6-5ea06b734364 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:19.652319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-a50e1e57-2ea2-4892-ade6-5ea06b734364 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:19.658371 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a50e1e57-2ea2-4892-ade6-5ea06b734364 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:19.658852 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a50e1e57-2ea2-4892-ade6-5ea06b734364 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:19.659287 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a50e1e57-2ea2-4892-ade6-5ea06b734364 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:19.659968 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a50e1e57-2ea2-4892-ade6-5ea06b734364 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:19.660419 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a50e1e57-2ea2-4892-ade6-5ea06b734364 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:19.660841 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a50e1e57-2ea2-4892-ade6-5ea06b734364 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:19.795751 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a50e1e57-2ea2-4892-ade6-5ea06b734364 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:19.804335 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-a50e1e57-2ea2-4892-ade6-5ea06b734364 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1259 microversion: 2.1 time: 0.156428 Oct 14 13:02:19.804910 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 149/303] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:19 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:20.312435 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b2c6a7d4-c2f4-4bb4-91cd-f2211d6e93ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:20.313014 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b2c6a7d4-c2f4-4bb4-91cd-f2211d6e93ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:20.319280 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b2c6a7d4-c2f4-4bb4-91cd-f2211d6e93ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:20.319751 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b2c6a7d4-c2f4-4bb4-91cd-f2211d6e93ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:20.320174 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b2c6a7d4-c2f4-4bb4-91cd-f2211d6e93ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:20.320850 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b2c6a7d4-c2f4-4bb4-91cd-f2211d6e93ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:20.321294 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b2c6a7d4-c2f4-4bb4-91cd-f2211d6e93ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:20.321742 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b2c6a7d4-c2f4-4bb4-91cd-f2211d6e93ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:20.450935 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b2c6a7d4-c2f4-4bb4-91cd-f2211d6e93ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:20.459045 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b2c6a7d4-c2f4-4bb4-91cd-f2211d6e93ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:20.460501 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b2c6a7d4-c2f4-4bb4-91cd-f2211d6e93ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:20.461697 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b2c6a7d4-c2f4-4bb4-91cd-f2211d6e93ed tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.153537 Oct 14 13:02:20.462261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 155/304] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:20 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:20.827373 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a6decb5e-ee87-4e8f-a299-b2d39a06ae0b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:20.828015 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-a6decb5e-ee87-4e8f-a299-b2d39a06ae0b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:20.834595 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a6decb5e-ee87-4e8f-a299-b2d39a06ae0b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:20.835084 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a6decb5e-ee87-4e8f-a299-b2d39a06ae0b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:20.835520 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a6decb5e-ee87-4e8f-a299-b2d39a06ae0b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:20.836205 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a6decb5e-ee87-4e8f-a299-b2d39a06ae0b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:20.836662 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a6decb5e-ee87-4e8f-a299-b2d39a06ae0b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:20.837098 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a6decb5e-ee87-4e8f-a299-b2d39a06ae0b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:20.967421 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a6decb5e-ee87-4e8f-a299-b2d39a06ae0b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:20.975575 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-a6decb5e-ee87-4e8f-a299-b2d39a06ae0b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1259 microversion: 2.1 time: 0.151638 Oct 14 13:02:20.976141 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 150/305] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:20 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:21.487351 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-3aa5c2a5-1f00-4596-b09e-f2bc4a855a68 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:21.487960 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-3aa5c2a5-1f00-4596-b09e-f2bc4a855a68 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:21.494781 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3aa5c2a5-1f00-4596-b09e-f2bc4a855a68 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:21.495265 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3aa5c2a5-1f00-4596-b09e-f2bc4a855a68 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:21.495700 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3aa5c2a5-1f00-4596-b09e-f2bc4a855a68 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:21.496376 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3aa5c2a5-1f00-4596-b09e-f2bc4a855a68 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:21.496827 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3aa5c2a5-1f00-4596-b09e-f2bc4a855a68 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:21.497249 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3aa5c2a5-1f00-4596-b09e-f2bc4a855a68 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:21.623356 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3aa5c2a5-1f00-4596-b09e-f2bc4a855a68 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:21.632599 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3aa5c2a5-1f00-4596-b09e-f2bc4a855a68 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:21.634087 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3aa5c2a5-1f00-4596-b09e-f2bc4a855a68 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:21.635366 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-3aa5c2a5-1f00-4596-b09e-f2bc4a855a68 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.152181 Oct 14 13:02:21.635928 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 156/306] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:21 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:21.999416 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5b9c6621-4a95-4e5a-b331-10c990b2d252 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:22.000069 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5b9c6621-4a95-4e5a-b331-10c990b2d252 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:22.006072 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5b9c6621-4a95-4e5a-b331-10c990b2d252 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:22.006554 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5b9c6621-4a95-4e5a-b331-10c990b2d252 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:22.006992 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5b9c6621-4a95-4e5a-b331-10c990b2d252 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:22.007678 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5b9c6621-4a95-4e5a-b331-10c990b2d252 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:22.008130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5b9c6621-4a95-4e5a-b331-10c990b2d252 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:22.008553 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5b9c6621-4a95-4e5a-b331-10c990b2d252 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:22.137996 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-5b9c6621-4a95-4e5a-b331-10c990b2d252 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:22.145718 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5b9c6621-4a95-4e5a-b331-10c990b2d252 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1259 microversion: 2.1 time: 0.150486 Oct 14 13:02:22.146287 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 151/307] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:21 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:22.660693 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0ea3b52c-3194-416e-bf0b-f42783439bd9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:22.661303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0ea3b52c-3194-416e-bf0b-f42783439bd9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:22.668220 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0ea3b52c-3194-416e-bf0b-f42783439bd9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:22.668707 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0ea3b52c-3194-416e-bf0b-f42783439bd9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:22.669146 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0ea3b52c-3194-416e-bf0b-f42783439bd9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:22.669861 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0ea3b52c-3194-416e-bf0b-f42783439bd9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:22.670317 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0ea3b52c-3194-416e-bf0b-f42783439bd9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:22.670750 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0ea3b52c-3194-416e-bf0b-f42783439bd9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:23.018140 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0ea3b52c-3194-416e-bf0b-f42783439bd9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:23.026880 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0ea3b52c-3194-416e-bf0b-f42783439bd9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:23.028324 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0ea3b52c-3194-416e-bf0b-f42783439bd9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:23.029471 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0ea3b52c-3194-416e-bf0b-f42783439bd9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1745 microversion: 2.20 time: 0.372706 Oct 14 13:02:23.030072 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 157/308] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:22 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1745 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:02:23.168298 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4b1a897c-2abd-4014-97b5-a33a5c2e252b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:23.168829 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4b1a897c-2abd-4014-97b5-a33a5c2e252b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:23.170823 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:23.176030 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4b1a897c-2abd-4014-97b5-a33a5c2e252b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:23.176816 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4b1a897c-2abd-4014-97b5-a33a5c2e252b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:23.177323 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4b1a897c-2abd-4014-97b5-a33a5c2e252b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:23.178652 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4b1a897c-2abd-4014-97b5-a33a5c2e252b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:23.179101 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4b1a897c-2abd-4014-97b5-a33a5c2e252b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:23.179516 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4b1a897c-2abd-4014-97b5-a33a5c2e252b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:23.309589 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4b1a897c-2abd-4014-97b5-a33a5c2e252b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:23.317249 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4b1a897c-2abd-4014-97b5-a33a5c2e252b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1259 microversion: 2.1 time: 0.153006 Oct 14 13:02:23.317844 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 152/309] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:23 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:24.056541 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ba6e3ba0-bd67-471a-a18b-f6151602eefe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:24.057086 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-ba6e3ba0-bd67-471a-a18b-f6151602eefe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:24.059473 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=2 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:24.064918 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba6e3ba0-bd67-471a-a18b-f6151602eefe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:24.065407 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba6e3ba0-bd67-471a-a18b-f6151602eefe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:24.065875 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba6e3ba0-bd67-471a-a18b-f6151602eefe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:24.066560 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba6e3ba0-bd67-471a-a18b-f6151602eefe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:24.067015 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba6e3ba0-bd67-471a-a18b-f6151602eefe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:24.067441 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba6e3ba0-bd67-471a-a18b-f6151602eefe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:24.194373 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ba6e3ba0-bd67-471a-a18b-f6151602eefe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:24.202540 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ba6e3ba0-bd67-471a-a18b-f6151602eefe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:24.204046 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ba6e3ba0-bd67-471a-a18b-f6151602eefe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:24.205211 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ba6e3ba0-bd67-471a-a18b-f6151602eefe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1745 microversion: 2.20 time: 0.153289 Oct 14 13:02:24.205866 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 158/310] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:24 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:24.340686 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c975a12b-a02d-4723-9cea-49a07093b191 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:24.341286 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c975a12b-a02d-4723-9cea-49a07093b191 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:24.343242 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:24.343882 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=6 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:24.350593 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c975a12b-a02d-4723-9cea-49a07093b191 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:24.351073 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c975a12b-a02d-4723-9cea-49a07093b191 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:24.351503 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c975a12b-a02d-4723-9cea-49a07093b191 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:24.352187 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c975a12b-a02d-4723-9cea-49a07093b191 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:24.352633 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c975a12b-a02d-4723-9cea-49a07093b191 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:24.353049 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c975a12b-a02d-4723-9cea-49a07093b191 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:24.373283 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:24.488473 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c975a12b-a02d-4723-9cea-49a07093b191 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:24.496721 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c975a12b-a02d-4723-9cea-49a07093b191 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1259 microversion: 2.1 time: 0.159963 Oct 14 13:02:24.497286 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 153/311] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:24 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:25.068723 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-b78bd634-d5f2-4e9c-86cf-93f649238193 req-5a7c3a92-7c53-4a6d-8aee-936aedc88dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f2bb08-a11d-46c6-96f5-9a9f85316fd0", "name": "network-vif-plugged", "status": "completed", "tag": "e3f9c588-4549-470d-90da-07db69916332"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:02:25.081261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-b78bd634-d5f2-4e9c-86cf-93f649238193 req-5a7c3a92-7c53-4a6d-8aee-936aedc88dc6 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:25.081924 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-b78bd634-d5f2-4e9c-86cf-93f649238193 req-5a7c3a92-7c53-4a6d-8aee-936aedc88dc6 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:25.082500 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-b78bd634-d5f2-4e9c-86cf-93f649238193 req-5a7c3a92-7c53-4a6d-8aee-936aedc88dc6 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:25.098204 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-b78bd634-d5f2-4e9c-86cf-93f649238193 req-5a7c3a92-7c53-4a6d-8aee-936aedc88dc6 service nova] Creating event network-vif-plugged:e3f9c588-4549-470d-90da-07db69916332 for instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 on hv-cinder-82099 Oct 14 13:02:25.105050 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-b78bd634-d5f2-4e9c-86cf-93f649238193 req-5a7c3a92-7c53-4a6d-8aee-936aedc88dc6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042517 Oct 14 13:02:25.105867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 159/312] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:02:25.232313 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-07d97644-dee8-4fd5-83db-a55113ce0491 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:25.233037 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-07d97644-dee8-4fd5-83db-a55113ce0491 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:25.240061 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07d97644-dee8-4fd5-83db-a55113ce0491 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:25.240866 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07d97644-dee8-4fd5-83db-a55113ce0491 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:25.241582 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07d97644-dee8-4fd5-83db-a55113ce0491 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:25.242354 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07d97644-dee8-4fd5-83db-a55113ce0491 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:25.243003 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07d97644-dee8-4fd5-83db-a55113ce0491 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:25.243628 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07d97644-dee8-4fd5-83db-a55113ce0491 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:25.403122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-07d97644-dee8-4fd5-83db-a55113ce0491 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:25.412483 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-07d97644-dee8-4fd5-83db-a55113ce0491 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:25.414586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-07d97644-dee8-4fd5-83db-a55113ce0491 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:25.415758 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-07d97644-dee8-4fd5-83db-a55113ce0491 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1740 microversion: 2.20 time: 0.187488 Oct 14 13:02:25.416496 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 154/313] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:25 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:25.523201 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0e6cb77e-fe24-438c-a63c-3db4c003f3a1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:25.524483 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0e6cb77e-fe24-438c-a63c-3db4c003f3a1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:25.531371 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e6cb77e-fe24-438c-a63c-3db4c003f3a1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:25.532064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e6cb77e-fe24-438c-a63c-3db4c003f3a1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:25.532679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e6cb77e-fe24-438c-a63c-3db4c003f3a1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:25.533660 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e6cb77e-fe24-438c-a63c-3db4c003f3a1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:25.534294 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e6cb77e-fe24-438c-a63c-3db4c003f3a1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:25.534884 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0e6cb77e-fe24-438c-a63c-3db4c003f3a1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:25.698799 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0e6cb77e-fe24-438c-a63c-3db4c003f3a1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:25.707718 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0e6cb77e-fe24-438c-a63c-3db4c003f3a1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1259 microversion: 2.1 time: 0.190475 Oct 14 13:02:25.708305 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 160/314] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:25 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:26.441694 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f3026cd7-64de-458b-a318-c4e17ec47560 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:26.443688 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f3026cd7-64de-458b-a318-c4e17ec47560 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:26.458190 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f3026cd7-64de-458b-a318-c4e17ec47560 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:26.458698 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f3026cd7-64de-458b-a318-c4e17ec47560 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:26.459195 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f3026cd7-64de-458b-a318-c4e17ec47560 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:26.461250 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f3026cd7-64de-458b-a318-c4e17ec47560 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:26.461943 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f3026cd7-64de-458b-a318-c4e17ec47560 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:26.462560 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f3026cd7-64de-458b-a318-c4e17ec47560 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:26.631717 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f3026cd7-64de-458b-a318-c4e17ec47560 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:26.640702 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f3026cd7-64de-458b-a318-c4e17ec47560 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:26.642285 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f3026cd7-64de-458b-a318-c4e17ec47560 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:26.643582 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-f3026cd7-64de-458b-a318-c4e17ec47560 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1740 microversion: 2.20 time: 0.205965 Oct 14 13:02:26.644270 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 155/315] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:26 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:26.731389 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-a542f2fa-28df-4dd4-a4f3-bf8f34d3a110 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:26.732083 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-a542f2fa-28df-4dd4-a4f3-bf8f34d3a110 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:26.740651 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a542f2fa-28df-4dd4-a4f3-bf8f34d3a110 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:26.741648 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a542f2fa-28df-4dd4-a4f3-bf8f34d3a110 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:26.742355 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a542f2fa-28df-4dd4-a4f3-bf8f34d3a110 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:26.743277 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a542f2fa-28df-4dd4-a4f3-bf8f34d3a110 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:26.743941 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a542f2fa-28df-4dd4-a4f3-bf8f34d3a110 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:26.744652 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a542f2fa-28df-4dd4-a4f3-bf8f34d3a110 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:26.903085 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-a542f2fa-28df-4dd4-a4f3-bf8f34d3a110 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:26.914811 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-a542f2fa-28df-4dd4-a4f3-bf8f34d3a110 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1259 microversion: 2.1 time: 0.187387 Oct 14 13:02:26.915677 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 161/316] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:26 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:27.129909 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-f14c220d-9469-4dec-adfd-0058cdbfda8f req-131ae3e3-6d8e-427b-a921-a3448c6cea29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f", "name": "network-vif-plugged", "status": "completed", "tag": "5974c9e5-7b5e-4f03-aaed-db90e7d7a18e"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:02:27.139858 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-f14c220d-9469-4dec-adfd-0058cdbfda8f req-131ae3e3-6d8e-427b-a921-a3448c6cea29 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:27.140594 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-f14c220d-9469-4dec-adfd-0058cdbfda8f req-131ae3e3-6d8e-427b-a921-a3448c6cea29 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:27.141194 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-f14c220d-9469-4dec-adfd-0058cdbfda8f req-131ae3e3-6d8e-427b-a921-a3448c6cea29 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:27.153705 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-f14c220d-9469-4dec-adfd-0058cdbfda8f req-131ae3e3-6d8e-427b-a921-a3448c6cea29 service nova] Creating event network-vif-plugged:5974c9e5-7b5e-4f03-aaed-db90e7d7a18e for instance 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f on hv-cinder-82099 Oct 14 13:02:27.159293 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-f14c220d-9469-4dec-adfd-0058cdbfda8f req-131ae3e3-6d8e-427b-a921-a3448c6cea29 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032964 Oct 14 13:02:27.160154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 156/317] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:02:27.673346 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-725aea37-19eb-4403-9050-b957acaa4c2d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:27.674017 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-725aea37-19eb-4403-9050-b957acaa4c2d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:27.680478 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-725aea37-19eb-4403-9050-b957acaa4c2d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:27.680966 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-725aea37-19eb-4403-9050-b957acaa4c2d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:27.681401 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-725aea37-19eb-4403-9050-b957acaa4c2d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:27.682136 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-725aea37-19eb-4403-9050-b957acaa4c2d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:27.682580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-725aea37-19eb-4403-9050-b957acaa4c2d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:27.682998 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-725aea37-19eb-4403-9050-b957acaa4c2d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:27.852347 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-725aea37-19eb-4403-9050-b957acaa4c2d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:27.862574 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-725aea37-19eb-4403-9050-b957acaa4c2d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:27.864320 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-725aea37-19eb-4403-9050-b957acaa4c2d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:27.865730 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-725aea37-19eb-4403-9050-b957acaa4c2d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1740 microversion: 2.20 time: 0.196294 Oct 14 13:02:27.866592 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 162/318] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:27 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:27.939140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-424592bd-7e13-408e-8d8f-16e73b45b526 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:27.939751 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-424592bd-7e13-408e-8d8f-16e73b45b526 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:27.946853 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-424592bd-7e13-408e-8d8f-16e73b45b526 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:27.947562 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-424592bd-7e13-408e-8d8f-16e73b45b526 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:27.948001 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-424592bd-7e13-408e-8d8f-16e73b45b526 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:27.948695 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-424592bd-7e13-408e-8d8f-16e73b45b526 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:27.949338 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-424592bd-7e13-408e-8d8f-16e73b45b526 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:27.949945 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-424592bd-7e13-408e-8d8f-16e73b45b526 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:28.092892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-424592bd-7e13-408e-8d8f-16e73b45b526 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:28.101206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-424592bd-7e13-408e-8d8f-16e73b45b526 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1259 microversion: 2.1 time: 0.166358 Oct 14 13:02:28.114421 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 157/319] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:27 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:28.890959 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c0a5a091-52b8-4fcd-8511-541eeced0aa3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:28.891711 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c0a5a091-52b8-4fcd-8511-541eeced0aa3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:28.898630 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c0a5a091-52b8-4fcd-8511-541eeced0aa3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:28.899387 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c0a5a091-52b8-4fcd-8511-541eeced0aa3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:28.900040 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c0a5a091-52b8-4fcd-8511-541eeced0aa3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:28.900709 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c0a5a091-52b8-4fcd-8511-541eeced0aa3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:28.901162 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c0a5a091-52b8-4fcd-8511-541eeced0aa3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:28.901728 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c0a5a091-52b8-4fcd-8511-541eeced0aa3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:29.044653 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c0a5a091-52b8-4fcd-8511-541eeced0aa3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:29.053874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c0a5a091-52b8-4fcd-8511-541eeced0aa3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:29.055715 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c0a5a091-52b8-4fcd-8511-541eeced0aa3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:29.057189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c0a5a091-52b8-4fcd-8511-541eeced0aa3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1740 microversion: 2.20 time: 0.170143 Oct 14 13:02:29.067587 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 163/320] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:28 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:29.126674 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-641f010c-0f88-4cda-bb5b-eda38075c7a9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:29.128210 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-641f010c-0f88-4cda-bb5b-eda38075c7a9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:29.135855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-641f010c-0f88-4cda-bb5b-eda38075c7a9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:29.136560 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-641f010c-0f88-4cda-bb5b-eda38075c7a9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:29.137005 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-641f010c-0f88-4cda-bb5b-eda38075c7a9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:29.137894 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-641f010c-0f88-4cda-bb5b-eda38075c7a9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:29.138353 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-641f010c-0f88-4cda-bb5b-eda38075c7a9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:29.138841 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-641f010c-0f88-4cda-bb5b-eda38075c7a9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:29.296060 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-641f010c-0f88-4cda-bb5b-eda38075c7a9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:29.307975 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-641f010c-0f88-4cda-bb5b-eda38075c7a9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1259 microversion: 2.1 time: 0.184403 Oct 14 13:02:29.308808 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 158/321] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:29 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:30.083205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0c277cb1-f28f-4a28-99a4-d61af239b7db tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:30.084622 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0c277cb1-f28f-4a28-99a4-d61af239b7db tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:30.091239 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c277cb1-f28f-4a28-99a4-d61af239b7db tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:30.091732 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c277cb1-f28f-4a28-99a4-d61af239b7db tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:30.092173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c277cb1-f28f-4a28-99a4-d61af239b7db tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:30.092872 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c277cb1-f28f-4a28-99a4-d61af239b7db tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:30.093325 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c277cb1-f28f-4a28-99a4-d61af239b7db tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:30.093774 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c277cb1-f28f-4a28-99a4-d61af239b7db tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:30.232512 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0c277cb1-f28f-4a28-99a4-d61af239b7db tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:30.241576 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0c277cb1-f28f-4a28-99a4-d61af239b7db tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:30.243049 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0c277cb1-f28f-4a28-99a4-d61af239b7db tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:30.244499 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0c277cb1-f28f-4a28-99a4-d61af239b7db tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1740 microversion: 2.20 time: 0.165455 Oct 14 13:02:30.245150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 164/322] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:30 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:30.334370 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-237d7aee-e0c4-4c94-883d-8ddf41df16f0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:30.335582 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-237d7aee-e0c4-4c94-883d-8ddf41df16f0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:30.342114 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-237d7aee-e0c4-4c94-883d-8ddf41df16f0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:30.342817 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-237d7aee-e0c4-4c94-883d-8ddf41df16f0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:30.343604 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-237d7aee-e0c4-4c94-883d-8ddf41df16f0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:30.344626 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-237d7aee-e0c4-4c94-883d-8ddf41df16f0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:30.346207 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-237d7aee-e0c4-4c94-883d-8ddf41df16f0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:30.347134 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-237d7aee-e0c4-4c94-883d-8ddf41df16f0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:30.491095 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-237d7aee-e0c4-4c94-883d-8ddf41df16f0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:30.499445 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-237d7aee-e0c4-4c94-883d-8ddf41df16f0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1443 microversion: 2.1 time: 0.169903 Oct 14 13:02:30.500242 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 159/323] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:30 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1443 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:30.523836 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-63216b19-803d-4b14-b304-c8f9d7e8b148 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:30.524454 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-63216b19-803d-4b14-b304-c8f9d7e8b148 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:30.531126 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-63216b19-803d-4b14-b304-c8f9d7e8b148 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:30.531616 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-63216b19-803d-4b14-b304-c8f9d7e8b148 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:30.532051 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-63216b19-803d-4b14-b304-c8f9d7e8b148 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:30.532754 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-63216b19-803d-4b14-b304-c8f9d7e8b148 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:30.533201 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-63216b19-803d-4b14-b304-c8f9d7e8b148 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:30.533650 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-63216b19-803d-4b14-b304-c8f9d7e8b148 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:30.685972 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-63216b19-803d-4b14-b304-c8f9d7e8b148 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:30.694157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-63216b19-803d-4b14-b304-c8f9d7e8b148 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1443 microversion: 2.1 time: 0.174288 Oct 14 13:02:30.694885 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 165/324] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:30 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1443 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:31.271115 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-39086dc6-ea14-46dc-88f6-c465e1ebbb7d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:31.272382 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-39086dc6-ea14-46dc-88f6-c465e1ebbb7d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:31.278829 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39086dc6-ea14-46dc-88f6-c465e1ebbb7d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:31.279496 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39086dc6-ea14-46dc-88f6-c465e1ebbb7d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:31.280031 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39086dc6-ea14-46dc-88f6-c465e1ebbb7d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:31.280850 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39086dc6-ea14-46dc-88f6-c465e1ebbb7d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:31.281581 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39086dc6-ea14-46dc-88f6-c465e1ebbb7d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:31.282126 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39086dc6-ea14-46dc-88f6-c465e1ebbb7d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:31.514503 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-39086dc6-ea14-46dc-88f6-c465e1ebbb7d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:31.539664 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-39086dc6-ea14-46dc-88f6-c465e1ebbb7d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:31.542874 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-39086dc6-ea14-46dc-88f6-c465e1ebbb7d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:31.544328 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-39086dc6-ea14-46dc-88f6-c465e1ebbb7d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1740 microversion: 2.20 time: 0.277322 Oct 14 13:02:31.546259 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 160/325] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:31 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:32.570674 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ebd343f9-93bb-4d25-a24d-b67045b650a0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:32.572009 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-ebd343f9-93bb-4d25-a24d-b67045b650a0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:32.578868 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ebd343f9-93bb-4d25-a24d-b67045b650a0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:32.580045 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ebd343f9-93bb-4d25-a24d-b67045b650a0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:32.580415 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ebd343f9-93bb-4d25-a24d-b67045b650a0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:32.581433 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ebd343f9-93bb-4d25-a24d-b67045b650a0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:32.582365 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ebd343f9-93bb-4d25-a24d-b67045b650a0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:32.582993 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ebd343f9-93bb-4d25-a24d-b67045b650a0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:32.754462 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ebd343f9-93bb-4d25-a24d-b67045b650a0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:32.763974 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ebd343f9-93bb-4d25-a24d-b67045b650a0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:32.766341 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ebd343f9-93bb-4d25-a24d-b67045b650a0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:32.767873 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ebd343f9-93bb-4d25-a24d-b67045b650a0 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1740 microversion: 2.20 time: 0.201986 Oct 14 13:02:32.768960 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 166/326] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:32 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:33.045705 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-85e505a9-5552-46ed-84f0-072db6476b6c req-8173e2b2-fe17-48b8-b403-f981fb172699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f", "tag": "5974c9e5-7b5e-4f03-aaed-db90e7d7a18e"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:02:33.066148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-85e505a9-5552-46ed-84f0-072db6476b6c req-8173e2b2-fe17-48b8-b403-f981fb172699 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:33.066989 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-85e505a9-5552-46ed-84f0-072db6476b6c req-8173e2b2-fe17-48b8-b403-f981fb172699 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:33.067620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-85e505a9-5552-46ed-84f0-072db6476b6c req-8173e2b2-fe17-48b8-b403-f981fb172699 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:33.083128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-85e505a9-5552-46ed-84f0-072db6476b6c req-8173e2b2-fe17-48b8-b403-f981fb172699 service nova] Creating event network-changed:5974c9e5-7b5e-4f03-aaed-db90e7d7a18e for instance 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f on hv-cinder-82099 Oct 14 13:02:33.089102 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-85e505a9-5552-46ed-84f0-072db6476b6c req-8173e2b2-fe17-48b8-b403-f981fb172699 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046891 Oct 14 13:02:33.090230 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 161/327] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:02:33.798903 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-78a51d5b-9579-4086-adda-8c3cd352a1e7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:33.800164 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-78a51d5b-9579-4086-adda-8c3cd352a1e7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:33.810518 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-78a51d5b-9579-4086-adda-8c3cd352a1e7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:33.811702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-78a51d5b-9579-4086-adda-8c3cd352a1e7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:33.812396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-78a51d5b-9579-4086-adda-8c3cd352a1e7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:33.814420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-78a51d5b-9579-4086-adda-8c3cd352a1e7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:33.815478 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-78a51d5b-9579-4086-adda-8c3cd352a1e7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:33.815951 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-78a51d5b-9579-4086-adda-8c3cd352a1e7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:33.986575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-78a51d5b-9579-4086-adda-8c3cd352a1e7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:33.996726 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-78a51d5b-9579-4086-adda-8c3cd352a1e7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:33.998442 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-78a51d5b-9579-4086-adda-8c3cd352a1e7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:33.999749 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-78a51d5b-9579-4086-adda-8c3cd352a1e7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1740 microversion: 2.20 time: 0.210747 Oct 14 13:02:34.000531 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 167/328] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:33 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:35.026359 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-085a2b24-acb6-41c3-95b9-ab1e0352e3d9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:35.027058 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-085a2b24-acb6-41c3-95b9-ab1e0352e3d9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:35.033301 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-085a2b24-acb6-41c3-95b9-ab1e0352e3d9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:35.033810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-085a2b24-acb6-41c3-95b9-ab1e0352e3d9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:35.034245 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-085a2b24-acb6-41c3-95b9-ab1e0352e3d9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:35.034951 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-085a2b24-acb6-41c3-95b9-ab1e0352e3d9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:35.035403 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-085a2b24-acb6-41c3-95b9-ab1e0352e3d9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:35.035825 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-085a2b24-acb6-41c3-95b9-ab1e0352e3d9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:35.174062 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-085a2b24-acb6-41c3-95b9-ab1e0352e3d9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:35.182922 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-085a2b24-acb6-41c3-95b9-ab1e0352e3d9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:35.184373 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-085a2b24-acb6-41c3-95b9-ab1e0352e3d9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:35.185574 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-085a2b24-acb6-41c3-95b9-ab1e0352e3d9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1722 microversion: 2.20 time: 0.163742 Oct 14 13:02:35.186127 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 162/329] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:35 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:36.211030 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0c09d288-196f-4059-97ec-3995a1178623 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:36.211666 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0c09d288-196f-4059-97ec-3995a1178623 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:36.218617 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c09d288-196f-4059-97ec-3995a1178623 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:36.219101 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c09d288-196f-4059-97ec-3995a1178623 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:36.219536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c09d288-196f-4059-97ec-3995a1178623 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:36.220220 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c09d288-196f-4059-97ec-3995a1178623 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:36.220671 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c09d288-196f-4059-97ec-3995a1178623 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:36.221092 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c09d288-196f-4059-97ec-3995a1178623 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:36.349072 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0c09d288-196f-4059-97ec-3995a1178623 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:36.357861 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0c09d288-196f-4059-97ec-3995a1178623 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:36.359727 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0c09d288-196f-4059-97ec-3995a1178623 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:36.360769 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0c09d288-196f-4059-97ec-3995a1178623 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1722 microversion: 2.20 time: 0.153638 Oct 14 13:02:36.361322 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 168/330] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:36 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:37.386612 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5896575e-bcc0-4298-9a20-409f04e6c6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:37.387224 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5896575e-bcc0-4298-9a20-409f04e6c6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:37.393270 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5896575e-bcc0-4298-9a20-409f04e6c6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:37.393774 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5896575e-bcc0-4298-9a20-409f04e6c6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:37.394246 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5896575e-bcc0-4298-9a20-409f04e6c6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:37.394925 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5896575e-bcc0-4298-9a20-409f04e6c6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:37.395374 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5896575e-bcc0-4298-9a20-409f04e6c6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:37.395792 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5896575e-bcc0-4298-9a20-409f04e6c6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:37.528735 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-5896575e-bcc0-4298-9a20-409f04e6c6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:37.537004 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-5896575e-bcc0-4298-9a20-409f04e6c6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:37.538521 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-5896575e-bcc0-4298-9a20-409f04e6c6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:37.539694 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5896575e-bcc0-4298-9a20-409f04e6c6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1722 microversion: 2.20 time: 0.157002 Oct 14 13:02:37.540253 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 163/331] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:37 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:38.564877 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2d64b57e-45c8-45b9-8614-eb2721d8ac60 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:38.565409 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2d64b57e-45c8-45b9-8614-eb2721d8ac60 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:38.571823 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d64b57e-45c8-45b9-8614-eb2721d8ac60 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:38.572296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d64b57e-45c8-45b9-8614-eb2721d8ac60 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:38.572723 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d64b57e-45c8-45b9-8614-eb2721d8ac60 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:38.573399 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d64b57e-45c8-45b9-8614-eb2721d8ac60 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:38.573890 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d64b57e-45c8-45b9-8614-eb2721d8ac60 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:38.574309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d64b57e-45c8-45b9-8614-eb2721d8ac60 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:38.592180 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=100 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:38.705749 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2d64b57e-45c8-45b9-8614-eb2721d8ac60 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:38.714862 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2d64b57e-45c8-45b9-8614-eb2721d8ac60 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:38.716310 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2d64b57e-45c8-45b9-8614-eb2721d8ac60 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:38.717466 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2d64b57e-45c8-45b9-8614-eb2721d8ac60 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1665 microversion: 2.20 time: 0.156571 Oct 14 13:02:38.718061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 169/332] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:38 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:38.742452 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-758f620b-0069-4fac-bab8-79d81553c294 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37224fa2-185d-4b5c-8ea0-90e62ebe2a6c"}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:02:38.744739 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-758f620b-0069-4fac-bab8-79d81553c294 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:38.750715 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-758f620b-0069-4fac-bab8-79d81553c294 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:38.751182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-758f620b-0069-4fac-bab8-79d81553c294 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:38.751607 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-758f620b-0069-4fac-bab8-79d81553c294 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:38.752280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-758f620b-0069-4fac-bab8-79d81553c294 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:38.752728 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-758f620b-0069-4fac-bab8-79d81553c294 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:38.753141 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-758f620b-0069-4fac-bab8-79d81553c294 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:38.944658 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-bc8e1737-e802-4b9f-a7df-6735b6caa3c1 req-1f3e4a53-a134-48c5-bbd7-bdece07cb0dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f2bb08-a11d-46c6-96f5-9a9f85316fd0", "name": "network-vif-unplugged", "status": "completed", "tag": "e3f9c588-4549-470d-90da-07db69916332"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:02:38.957979 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-bc8e1737-e802-4b9f-a7df-6735b6caa3c1 req-1f3e4a53-a134-48c5-bbd7-bdece07cb0dd service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:38.958994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-bc8e1737-e802-4b9f-a7df-6735b6caa3c1 req-1f3e4a53-a134-48c5-bbd7-bdece07cb0dd service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:38.959435 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-bc8e1737-e802-4b9f-a7df-6735b6caa3c1 req-1f3e4a53-a134-48c5-bbd7-bdece07cb0dd service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:38.977753 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.compute.server_external_events [req-bc8e1737-e802-4b9f-a7df-6735b6caa3c1 req-1f3e4a53-a134-48c5-bbd7-bdece07cb0dd service nova] Unable to find a host for instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0. Dropping event network-vif-unplugged {{(pid=118868) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 14 13:02:38.978740 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-bc8e1737-e802-4b9f-a7df-6735b6caa3c1 req-1f3e4a53-a134-48c5-bbd7-bdece07cb0dd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038636 Oct 14 13:02:38.979710 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 170/333] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 14 13:02:39.069616 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-758f620b-0069-4fac-bab8-79d81553c294 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "POST /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.331450 Oct 14 13:02:39.070130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 164/334] 10.222.0.47 () {62 vars in 1364 bytes} [Fri Oct 14 13:02:38 2022] POST /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/os-volume_attachments => generated 188 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 13:02:39.191827 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-748ba052-11f5-4e38-853a-cc63bb3e1f71 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:02:39.192418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-748ba052-11f5-4e38-853a-cc63bb3e1f71 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:39.198927 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-748ba052-11f5-4e38-853a-cc63bb3e1f71 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:39.199409 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-748ba052-11f5-4e38-853a-cc63bb3e1f71 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:39.199838 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-748ba052-11f5-4e38-853a-cc63bb3e1f71 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:39.200522 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-748ba052-11f5-4e38-853a-cc63bb3e1f71 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:39.200967 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-748ba052-11f5-4e38-853a-cc63bb3e1f71 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:39.201391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-748ba052-11f5-4e38-853a-cc63bb3e1f71 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:39.242896 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-748ba052-11f5-4e38-853a-cc63bb3e1f71 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118868) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 14 13:02:39.308642 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-748ba052-11f5-4e38-853a-cc63bb3e1f71 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "POST /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/action" status: 202 len: 0 microversion: 2.20 time: 0.120671 Oct 14 13:02:39.309291 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 171/335] 10.222.0.47 () {62 vars in 1319 bytes} [Fri Oct 14 13:02:39 2022] POST /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:02:39.317345 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-73a05ded-e979-44a8-8232-c9f3c5eae648 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:39.318651 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-73a05ded-e979-44a8-8232-c9f3c5eae648 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:39.325021 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-73a05ded-e979-44a8-8232-c9f3c5eae648 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:39.325540 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-73a05ded-e979-44a8-8232-c9f3c5eae648 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:39.325981 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-73a05ded-e979-44a8-8232-c9f3c5eae648 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:39.326678 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-73a05ded-e979-44a8-8232-c9f3c5eae648 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:39.327132 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-73a05ded-e979-44a8-8232-c9f3c5eae648 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:39.327556 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-73a05ded-e979-44a8-8232-c9f3c5eae648 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:39.480727 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-73a05ded-e979-44a8-8232-c9f3c5eae648 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:39.490561 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-73a05ded-e979-44a8-8232-c9f3c5eae648 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:39.492023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-73a05ded-e979-44a8-8232-c9f3c5eae648 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:39.493355 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-73a05ded-e979-44a8-8232-c9f3c5eae648 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1751 microversion: 2.20 time: 0.179852 Oct 14 13:02:39.493847 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 165/336] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:39 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:02:40.517968 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f5efa985-4d91-4487-b3c5-f70f9d784539 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:40.518568 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-f5efa985-4d91-4487-b3c5-f70f9d784539 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:40.524507 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5efa985-4d91-4487-b3c5-f70f9d784539 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:40.524988 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5efa985-4d91-4487-b3c5-f70f9d784539 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:40.525419 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5efa985-4d91-4487-b3c5-f70f9d784539 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:40.526119 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5efa985-4d91-4487-b3c5-f70f9d784539 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:40.526566 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5efa985-4d91-4487-b3c5-f70f9d784539 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:40.526987 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5efa985-4d91-4487-b3c5-f70f9d784539 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:40.655055 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f5efa985-4d91-4487-b3c5-f70f9d784539 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:40.663811 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f5efa985-4d91-4487-b3c5-f70f9d784539 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:40.665287 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f5efa985-4d91-4487-b3c5-f70f9d784539 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:40.666487 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f5efa985-4d91-4487-b3c5-f70f9d784539 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1753 microversion: 2.20 time: 0.152996 Oct 14 13:02:40.667044 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 172/337] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:40 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:41.692216 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c1828bc4-be83-49aa-8b67-914e9a865cd7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:41.692837 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c1828bc4-be83-49aa-8b67-914e9a865cd7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:41.698905 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c1828bc4-be83-49aa-8b67-914e9a865cd7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:41.699390 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c1828bc4-be83-49aa-8b67-914e9a865cd7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:41.699822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c1828bc4-be83-49aa-8b67-914e9a865cd7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:41.700515 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c1828bc4-be83-49aa-8b67-914e9a865cd7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:41.700966 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c1828bc4-be83-49aa-8b67-914e9a865cd7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:41.701449 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c1828bc4-be83-49aa-8b67-914e9a865cd7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:41.834434 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c1828bc4-be83-49aa-8b67-914e9a865cd7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:41.842967 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c1828bc4-be83-49aa-8b67-914e9a865cd7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:41.844440 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c1828bc4-be83-49aa-8b67-914e9a865cd7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:41.845629 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c1828bc4-be83-49aa-8b67-914e9a865cd7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.157363 Oct 14 13:02:41.846179 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 166/338] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:41 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:42.872055 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9e76db72-5958-45da-916c-da7556886277 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:42.872662 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-9e76db72-5958-45da-916c-da7556886277 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:42.879031 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e76db72-5958-45da-916c-da7556886277 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:42.879514 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e76db72-5958-45da-916c-da7556886277 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:42.879944 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e76db72-5958-45da-916c-da7556886277 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:42.881204 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e76db72-5958-45da-916c-da7556886277 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:42.881690 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e76db72-5958-45da-916c-da7556886277 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:42.882114 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e76db72-5958-45da-916c-da7556886277 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:43.026038 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9e76db72-5958-45da-916c-da7556886277 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:43.034808 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9e76db72-5958-45da-916c-da7556886277 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:43.036272 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9e76db72-5958-45da-916c-da7556886277 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:43.037443 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-9e76db72-5958-45da-916c-da7556886277 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.169258 Oct 14 13:02:43.038098 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 173/339] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:42 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:44.062712 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4cd8ce5d-f1cf-43b1-93bb-86c358471410 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:44.063299 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4cd8ce5d-f1cf-43b1-93bb-86c358471410 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:44.074856 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cd8ce5d-f1cf-43b1-93bb-86c358471410 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:44.075348 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cd8ce5d-f1cf-43b1-93bb-86c358471410 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:44.075777 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cd8ce5d-f1cf-43b1-93bb-86c358471410 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:44.076478 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cd8ce5d-f1cf-43b1-93bb-86c358471410 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:44.076925 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cd8ce5d-f1cf-43b1-93bb-86c358471410 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:44.077343 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cd8ce5d-f1cf-43b1-93bb-86c358471410 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:44.210956 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4cd8ce5d-f1cf-43b1-93bb-86c358471410 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:44.220489 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4cd8ce5d-f1cf-43b1-93bb-86c358471410 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:44.221951 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4cd8ce5d-f1cf-43b1-93bb-86c358471410 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:44.223106 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4cd8ce5d-f1cf-43b1-93bb-86c358471410 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.164750 Oct 14 13:02:44.223655 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 167/340] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:44 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:45.250660 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ab77f5d0-5b1e-47a6-a590-e9d93ccf715e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:45.251292 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-ab77f5d0-5b1e-47a6-a590-e9d93ccf715e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:45.269030 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab77f5d0-5b1e-47a6-a590-e9d93ccf715e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:45.269909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab77f5d0-5b1e-47a6-a590-e9d93ccf715e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:45.270622 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab77f5d0-5b1e-47a6-a590-e9d93ccf715e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:45.272160 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab77f5d0-5b1e-47a6-a590-e9d93ccf715e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:45.272864 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab77f5d0-5b1e-47a6-a590-e9d93ccf715e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:45.273614 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab77f5d0-5b1e-47a6-a590-e9d93ccf715e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:45.414472 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ab77f5d0-5b1e-47a6-a590-e9d93ccf715e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:45.422951 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ab77f5d0-5b1e-47a6-a590-e9d93ccf715e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:45.424412 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ab77f5d0-5b1e-47a6-a590-e9d93ccf715e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:45.425633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ab77f5d0-5b1e-47a6-a590-e9d93ccf715e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.179471 Oct 14 13:02:45.426387 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 174/341] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:45 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:46.452305 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-06e700d6-f78e-4df9-b140-8b5cecc1ce88 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:46.452960 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-06e700d6-f78e-4df9-b140-8b5cecc1ce88 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:46.469162 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06e700d6-f78e-4df9-b140-8b5cecc1ce88 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:46.469788 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06e700d6-f78e-4df9-b140-8b5cecc1ce88 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:46.470316 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06e700d6-f78e-4df9-b140-8b5cecc1ce88 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:46.471153 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06e700d6-f78e-4df9-b140-8b5cecc1ce88 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:46.471720 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06e700d6-f78e-4df9-b140-8b5cecc1ce88 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:46.472234 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06e700d6-f78e-4df9-b140-8b5cecc1ce88 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:46.606576 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-06e700d6-f78e-4df9-b140-8b5cecc1ce88 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:46.610364 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:46.616526 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-06e700d6-f78e-4df9-b140-8b5cecc1ce88 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:46.618015 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-06e700d6-f78e-4df9-b140-8b5cecc1ce88 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:46.619171 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-06e700d6-f78e-4df9-b140-8b5cecc1ce88 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.170839 Oct 14 13:02:46.619724 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 168/342] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:46 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:47.644436 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-dddd82d7-f60c-4e45-a1b1-0b284bd216c1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:47.645078 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-dddd82d7-f60c-4e45-a1b1-0b284bd216c1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:47.648092 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:47.653360 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dddd82d7-f60c-4e45-a1b1-0b284bd216c1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:47.654064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dddd82d7-f60c-4e45-a1b1-0b284bd216c1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:47.654504 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dddd82d7-f60c-4e45-a1b1-0b284bd216c1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:47.655187 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dddd82d7-f60c-4e45-a1b1-0b284bd216c1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:47.655637 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dddd82d7-f60c-4e45-a1b1-0b284bd216c1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:47.656059 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dddd82d7-f60c-4e45-a1b1-0b284bd216c1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:47.797136 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-dddd82d7-f60c-4e45-a1b1-0b284bd216c1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:47.805954 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-dddd82d7-f60c-4e45-a1b1-0b284bd216c1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:47.807401 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-dddd82d7-f60c-4e45-a1b1-0b284bd216c1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:47.808576 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-dddd82d7-f60c-4e45-a1b1-0b284bd216c1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.168120 Oct 14 13:02:47.809137 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 175/343] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:47 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:48.835000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c4b89deb-a887-4f7b-847c-5ad6d7ec2815 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:48.835604 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c4b89deb-a887-4f7b-847c-5ad6d7ec2815 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:48.843313 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c4b89deb-a887-4f7b-847c-5ad6d7ec2815 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:48.843801 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c4b89deb-a887-4f7b-847c-5ad6d7ec2815 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:48.844306 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c4b89deb-a887-4f7b-847c-5ad6d7ec2815 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:48.845063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c4b89deb-a887-4f7b-847c-5ad6d7ec2815 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:48.845715 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c4b89deb-a887-4f7b-847c-5ad6d7ec2815 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:48.845969 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c4b89deb-a887-4f7b-847c-5ad6d7ec2815 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:49.000376 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c4b89deb-a887-4f7b-847c-5ad6d7ec2815 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:49.024970 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c4b89deb-a887-4f7b-847c-5ad6d7ec2815 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:49.026467 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c4b89deb-a887-4f7b-847c-5ad6d7ec2815 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:49.027629 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c4b89deb-a887-4f7b-847c-5ad6d7ec2815 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.197271 Oct 14 13:02:49.028183 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 169/344] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:48 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:50.053040 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-a4c88e02-cdba-4976-88f4-0ec47bd1e25f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:50.053696 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-a4c88e02-cdba-4976-88f4-0ec47bd1e25f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:50.060216 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a4c88e02-cdba-4976-88f4-0ec47bd1e25f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:50.060705 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a4c88e02-cdba-4976-88f4-0ec47bd1e25f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:50.061144 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a4c88e02-cdba-4976-88f4-0ec47bd1e25f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:50.062021 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a4c88e02-cdba-4976-88f4-0ec47bd1e25f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:50.062484 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a4c88e02-cdba-4976-88f4-0ec47bd1e25f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:50.062926 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a4c88e02-cdba-4976-88f4-0ec47bd1e25f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:50.208891 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-a4c88e02-cdba-4976-88f4-0ec47bd1e25f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:50.218816 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-a4c88e02-cdba-4976-88f4-0ec47bd1e25f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:50.224426 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-a4c88e02-cdba-4976-88f4-0ec47bd1e25f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:50.225909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-a4c88e02-cdba-4976-88f4-0ec47bd1e25f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.177324 Oct 14 13:02:50.226593 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 176/345] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:50 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:51.252297 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d47338af-14da-4407-9b9a-8b627e5eb4aa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:51.252855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-d47338af-14da-4407-9b9a-8b627e5eb4aa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:51.259514 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d47338af-14da-4407-9b9a-8b627e5eb4aa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:51.259992 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d47338af-14da-4407-9b9a-8b627e5eb4aa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:51.260443 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d47338af-14da-4407-9b9a-8b627e5eb4aa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:51.261096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d47338af-14da-4407-9b9a-8b627e5eb4aa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:51.261565 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d47338af-14da-4407-9b9a-8b627e5eb4aa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:51.262055 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d47338af-14da-4407-9b9a-8b627e5eb4aa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:51.405740 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-d47338af-14da-4407-9b9a-8b627e5eb4aa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:51.415825 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-d47338af-14da-4407-9b9a-8b627e5eb4aa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:51.417302 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-d47338af-14da-4407-9b9a-8b627e5eb4aa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:51.418534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-d47338af-14da-4407-9b9a-8b627e5eb4aa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.170257 Oct 14 13:02:51.419092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 170/346] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:51 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:52.181699 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c7e49d4a-3b42-44fc-b7f2-8e5cc0ce9b0f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c432df6d-01c3-42cf-8865-66387bcf439f"}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:02:52.184098 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c7e49d4a-3b42-44fc-b7f2-8e5cc0ce9b0f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:52.190571 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7e49d4a-3b42-44fc-b7f2-8e5cc0ce9b0f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:52.191087 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7e49d4a-3b42-44fc-b7f2-8e5cc0ce9b0f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:52.191527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7e49d4a-3b42-44fc-b7f2-8e5cc0ce9b0f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:52.192213 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7e49d4a-3b42-44fc-b7f2-8e5cc0ce9b0f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:52.193195 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7e49d4a-3b42-44fc-b7f2-8e5cc0ce9b0f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:52.193652 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7e49d4a-3b42-44fc-b7f2-8e5cc0ce9b0f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:52.445082 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cb8eaf23-7f36-4d26-a1cf-e796ee367828 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:52.445881 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-cb8eaf23-7f36-4d26-a1cf-e796ee367828 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:52.451962 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cb8eaf23-7f36-4d26-a1cf-e796ee367828 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:52.452448 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cb8eaf23-7f36-4d26-a1cf-e796ee367828 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:52.452881 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cb8eaf23-7f36-4d26-a1cf-e796ee367828 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:52.453594 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cb8eaf23-7f36-4d26-a1cf-e796ee367828 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:52.454047 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cb8eaf23-7f36-4d26-a1cf-e796ee367828 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:52.454472 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cb8eaf23-7f36-4d26-a1cf-e796ee367828 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:52.597230 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-cb8eaf23-7f36-4d26-a1cf-e796ee367828 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:52.605990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-cb8eaf23-7f36-4d26-a1cf-e796ee367828 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:52.607432 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-cb8eaf23-7f36-4d26-a1cf-e796ee367828 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:52.608579 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-cb8eaf23-7f36-4d26-a1cf-e796ee367828 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.168055 Oct 14 13:02:52.609144 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 171/347] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:52 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:02:53.634885 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e259ce23-7092-45cb-a934-0aa6ec52747e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:53.635579 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e259ce23-7092-45cb-a934-0aa6ec52747e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:53.637304 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=40 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:53.642557 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e259ce23-7092-45cb-a934-0aa6ec52747e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:53.643040 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e259ce23-7092-45cb-a934-0aa6ec52747e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:53.643474 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e259ce23-7092-45cb-a934-0aa6ec52747e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:53.644161 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e259ce23-7092-45cb-a934-0aa6ec52747e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:53.644612 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e259ce23-7092-45cb-a934-0aa6ec52747e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:53.645037 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e259ce23-7092-45cb-a934-0aa6ec52747e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:53.778782 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e259ce23-7092-45cb-a934-0aa6ec52747e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:53.799497 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e259ce23-7092-45cb-a934-0aa6ec52747e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:53.800953 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e259ce23-7092-45cb-a934-0aa6ec52747e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:53.802221 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e259ce23-7092-45cb-a934-0aa6ec52747e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.171271 Oct 14 13:02:53.803101 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 172/348] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:53 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:02:54.807356 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-88ae5c6f-d049-4e22-802b-22b845fdb25a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:54.808040 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-88ae5c6f-d049-4e22-802b-22b845fdb25a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:54.813888 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-88ae5c6f-d049-4e22-802b-22b845fdb25a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:54.814373 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-88ae5c6f-d049-4e22-802b-22b845fdb25a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:54.814806 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-88ae5c6f-d049-4e22-802b-22b845fdb25a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:54.815491 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-88ae5c6f-d049-4e22-802b-22b845fdb25a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:54.815946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-88ae5c6f-d049-4e22-802b-22b845fdb25a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:54.816366 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-88ae5c6f-d049-4e22-802b-22b845fdb25a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:54.938795 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-88ae5c6f-d049-4e22-802b-22b845fdb25a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lazy-loading 'services' on Instance uuid 24c6dfd1-715d-4239-a767-32f2e2dcf892 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:02:55.049294 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-88ae5c6f-d049-4e22-802b-22b845fdb25a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "DELETE /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/os-volume_attachments/9a18e205-b8e1-4cd0-986c-d455b239035a" status: 202 len: 0 microversion: 2.1 time: 0.245734 Oct 14 13:02:55.049917 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 173/349] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Oct 14 13:02:54 2022] DELETE /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/os-volume_attachments/9a18e205-b8e1-4cd0-986c-d455b239035a => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 13:02:55.055151 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a7c05407-91be-4eef-a4c0-bdb88d4d8def tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:55.055819 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-a7c05407-91be-4eef-a4c0-bdb88d4d8def tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:55.062050 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a7c05407-91be-4eef-a4c0-bdb88d4d8def tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:55.062520 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a7c05407-91be-4eef-a4c0-bdb88d4d8def tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:55.062954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a7c05407-91be-4eef-a4c0-bdb88d4d8def tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:55.063642 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a7c05407-91be-4eef-a4c0-bdb88d4d8def tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:55.064129 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a7c05407-91be-4eef-a4c0-bdb88d4d8def tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:55.064545 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a7c05407-91be-4eef-a4c0-bdb88d4d8def tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:55.199647 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a7c05407-91be-4eef-a4c0-bdb88d4d8def tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:55.208761 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a7c05407-91be-4eef-a4c0-bdb88d4d8def tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:55.210276 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a7c05407-91be-4eef-a4c0-bdb88d4d8def tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:55.211456 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-a7c05407-91be-4eef-a4c0-bdb88d4d8def tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.160452 Oct 14 13:02:55.212019 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 174/350] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:55 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:56.143349 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c7e49d4a-3b42-44fc-b7f2-8e5cc0ce9b0f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "POST /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.965255 Oct 14 13:02:56.143964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 177/351] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Oct 14 13:02:52 2022] POST /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/os-volume_attachments => generated 194 bytes in 3967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:02:56.236240 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c63a0b84-f02d-419a-b66b-43d1e7aa863d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:56.236848 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c63a0b84-f02d-419a-b66b-43d1e7aa863d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:56.243355 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c63a0b84-f02d-419a-b66b-43d1e7aa863d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:56.243840 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c63a0b84-f02d-419a-b66b-43d1e7aa863d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:56.244277 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c63a0b84-f02d-419a-b66b-43d1e7aa863d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:56.244965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c63a0b84-f02d-419a-b66b-43d1e7aa863d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:56.245420 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c63a0b84-f02d-419a-b66b-43d1e7aa863d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:56.245872 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c63a0b84-f02d-419a-b66b-43d1e7aa863d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:56.371824 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c63a0b84-f02d-419a-b66b-43d1e7aa863d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:56.380899 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c63a0b84-f02d-419a-b66b-43d1e7aa863d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:56.382357 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c63a0b84-f02d-419a-b66b-43d1e7aa863d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:56.383498 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c63a0b84-f02d-419a-b66b-43d1e7aa863d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.151379 Oct 14 13:02:56.384046 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 175/352] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:56 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:02:56.814190 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-149db540-b0df-4cdc-b12d-248b9dbdd47d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:56.815404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-149db540-b0df-4cdc-b12d-248b9dbdd47d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:56.821826 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-149db540-b0df-4cdc-b12d-248b9dbdd47d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:56.822759 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-149db540-b0df-4cdc-b12d-248b9dbdd47d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:56.823182 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-149db540-b0df-4cdc-b12d-248b9dbdd47d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:56.824049 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-149db540-b0df-4cdc-b12d-248b9dbdd47d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:56.824502 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-149db540-b0df-4cdc-b12d-248b9dbdd47d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:56.824927 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-149db540-b0df-4cdc-b12d-248b9dbdd47d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:56.849205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-149db540-b0df-4cdc-b12d-248b9dbdd47d tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee/ips" status: 200 len: 149 microversion: 2.1 time: 0.039689 Oct 14 13:02:56.850283 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 178/353] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Oct 14 13:02:56 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:02:56.861697 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-340a35d9-8013-44c2-80fa-245a5544a3bc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a930cf3-00fb-42d3-8326-97367f550838"}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:02:56.864871 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-340a35d9-8013-44c2-80fa-245a5544a3bc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:56.871145 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-340a35d9-8013-44c2-80fa-245a5544a3bc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:56.871963 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-340a35d9-8013-44c2-80fa-245a5544a3bc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:56.872562 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-340a35d9-8013-44c2-80fa-245a5544a3bc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:56.873415 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-340a35d9-8013-44c2-80fa-245a5544a3bc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:56.874049 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-340a35d9-8013-44c2-80fa-245a5544a3bc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:56.874646 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-340a35d9-8013-44c2-80fa-245a5544a3bc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:56.967320 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-340a35d9-8013-44c2-80fa-245a5544a3bc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] HTTP exception thrown: Invalid volume: volume 3a930cf3-00fb-42d3-8326-97367f550838 is already attached to instances: defcc0c0-d0f4-4913-899d-4d20b75896d6 Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-340a35d9-8013-44c2-80fa-245a5544a3bc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Request method failure captured: Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: POST /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee/os-volume_attachments HTTP/1.1 Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 74 Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1FViMK-WvBvO8SLI8drD1UcXlTPANFWG-ZTvaw7ModKJdGRWngdLI5cp6n7bXZ7oPe4LkLOonqm901dlPL1Z_CDQlnflfzMT4YPNiiBNZ_K890mBj2sVo-ptm5duO44Ujpzx_OuaK4ZxTnFio58yttRWo_3AshSXsX0p_7cyovml4 Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:02:56.969044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:02:56.970471 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c0d083e8cef4333b9514d2256991647", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:02:56.970471 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:02:56.970471 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:02:56.970471 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:02:56.970471 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:02:56.970471 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:02:56.970471 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:02:56.970471 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 0bcbf6513b6a4df3b044fadfb7888d54 Oct 14 13:02:56.970471 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:02:56.970471 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Oct 14 13:02:56.970471 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {"volumeAttachment": {"volumeId": "3a930cf3-00fb-42d3-8326-97367f550838"}} Oct 14 13:02:56.970471 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Invalid volume: volume 3a930cf3-00fb-42d3-8326-97367f550838 is already attached to instances: defcc0c0-d0f4-4913-899d-4d20b75896d6 Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'server_id': '5fe0d2ae-312a-4c18-96d6-ae8d86372eee', 'body': {'volumeAttachment': {'volumeId': '3a930cf3-00fb-42d3-8326-97367f550838'}}} Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3a930cf3-00fb-42d3-8326-97367f550838 is already attached to instances: defcc0c0-d0f4-4913-899d-4d20b75896d6 Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:02:56.971296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3a930cf3-00fb-42d3-8326-97367f550838 is already attached to instances: defcc0c0-d0f4-4913-899d-4d20b75896d6 Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:02:56.972461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:02:56.973704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:02:56.973704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:02:56.973704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:02:56.973704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3a930cf3-00fb-42d3-8326-97367f550838 is already attached to instances: defcc0c0-d0f4-4913-899d-4d20b75896d6 Oct 14 13:02:56.973704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:02:56.973704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-340a35d9-8013-44c2-80fa-245a5544a3bc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Returning 400 to user: Invalid volume: volume 3a930cf3-00fb-42d3-8326-97367f550838 is already attached to instances: defcc0c0-d0f4-4913-899d-4d20b75896d6 {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:02:56.973704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-340a35d9-8013-44c2-80fa-245a5544a3bc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "POST /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113037 Oct 14 13:02:56.973704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 176/354] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Oct 14 13:02:56 2022] POST /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 13:02:56.979714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-01f21a43-9332-43d4-8589-403e1bc1acd6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:56.980406 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-01f21a43-9332-43d4-8589-403e1bc1acd6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:56.987985 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-01f21a43-9332-43d4-8589-403e1bc1acd6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:56.988485 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-01f21a43-9332-43d4-8589-403e1bc1acd6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:56.988915 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-01f21a43-9332-43d4-8589-403e1bc1acd6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:56.990539 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-01f21a43-9332-43d4-8589-403e1bc1acd6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:56.991261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-01f21a43-9332-43d4-8589-403e1bc1acd6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:56.991684 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-01f21a43-9332-43d4-8589-403e1bc1acd6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:57.020028 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-01f21a43-9332-43d4-8589-403e1bc1acd6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Going to try to terminate instance {{(pid=118868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:02:57.095367 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-01f21a43-9332-43d4-8589-403e1bc1acd6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 204 len: 0 microversion: 2.1 time: 0.119270 Oct 14 13:02:57.095947 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 179/355] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:02:56 2022] DELETE /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:02:57.104347 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ec1259a7-67cb-499f-8f7c-cc9feac391f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:57.104956 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ec1259a7-67cb-499f-8f7c-cc9feac391f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:57.111930 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec1259a7-67cb-499f-8f7c-cc9feac391f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:57.112429 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec1259a7-67cb-499f-8f7c-cc9feac391f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:57.112859 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec1259a7-67cb-499f-8f7c-cc9feac391f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:57.113569 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec1259a7-67cb-499f-8f7c-cc9feac391f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:57.114536 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec1259a7-67cb-499f-8f7c-cc9feac391f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:57.114965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec1259a7-67cb-499f-8f7c-cc9feac391f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:57.236569 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-fb3072b8-4c10-4893-9e79-641c65e0b738 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:02:57.243482 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fb3072b8-4c10-4893-9e79-641c65e0b738 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:57.243962 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fb3072b8-4c10-4893-9e79-641c65e0b738 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:57.244397 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fb3072b8-4c10-4893-9e79-641c65e0b738 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:57.253561 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ec1259a7-67cb-499f-8f7c-cc9feac391f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:57.264875 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ec1259a7-67cb-499f-8f7c-cc9feac391f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1681 microversion: 2.1 time: 0.164218 Oct 14 13:02:57.279967 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-fb3072b8-4c10-4893-9e79-641c65e0b738 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Going to try to stop instance {{(pid=118868) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 14 13:02:57.280066 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 177/356] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:57 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:57.318629 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-fb3072b8-4c10-4893-9e79-641c65e0b738 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "POST /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/action" status: 202 len: 0 microversion: 2.1 time: 0.086696 Oct 14 13:02:57.322667 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 180/357] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Oct 14 13:02:57 2022] POST /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 13:02:57.328095 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c66e7dd5-7a73-4da4-9976-e1663823cc57 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:57.328880 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c66e7dd5-7a73-4da4-9976-e1663823cc57 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:57.335720 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c66e7dd5-7a73-4da4-9976-e1663823cc57 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:57.336215 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c66e7dd5-7a73-4da4-9976-e1663823cc57 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:57.336648 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c66e7dd5-7a73-4da4-9976-e1663823cc57 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:57.337376 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c66e7dd5-7a73-4da4-9976-e1663823cc57 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:57.338013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c66e7dd5-7a73-4da4-9976-e1663823cc57 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:57.338438 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c66e7dd5-7a73-4da4-9976-e1663823cc57 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:57.408950 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-56e767bf-d057-4e4c-87c3-fe89acd2bf65 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:57.409710 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-56e767bf-d057-4e4c-87c3-fe89acd2bf65 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:57.416001 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-56e767bf-d057-4e4c-87c3-fe89acd2bf65 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:57.416487 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-56e767bf-d057-4e4c-87c3-fe89acd2bf65 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:57.416927 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-56e767bf-d057-4e4c-87c3-fe89acd2bf65 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:57.417670 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-56e767bf-d057-4e4c-87c3-fe89acd2bf65 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:57.418166 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-56e767bf-d057-4e4c-87c3-fe89acd2bf65 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:57.418592 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-56e767bf-d057-4e4c-87c3-fe89acd2bf65 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:57.472062 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c66e7dd5-7a73-4da4-9976-e1663823cc57 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:57.479998 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c66e7dd5-7a73-4da4-9976-e1663823cc57 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1676 microversion: 2.1 time: 0.156127 Oct 14 13:02:57.480572 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 178/358] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:57 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:02:57.552676 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-56e767bf-d057-4e4c-87c3-fe89acd2bf65 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:57.561277 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-56e767bf-d057-4e4c-87c3-fe89acd2bf65 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:57.562769 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-56e767bf-d057-4e4c-87c3-fe89acd2bf65 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:57.563935 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-56e767bf-d057-4e4c-87c3-fe89acd2bf65 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.159380 Oct 14 13:02:57.564493 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 181/359] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:57 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:02:58.290765 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a2ac7f48-5cd2-4625-bc36-47adcbabcf86 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:58.291408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-a2ac7f48-5cd2-4625-bc36-47adcbabcf86 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:58.297381 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a2ac7f48-5cd2-4625-bc36-47adcbabcf86 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:58.297899 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a2ac7f48-5cd2-4625-bc36-47adcbabcf86 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:58.298340 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a2ac7f48-5cd2-4625-bc36-47adcbabcf86 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:58.299031 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a2ac7f48-5cd2-4625-bc36-47adcbabcf86 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:58.299490 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a2ac7f48-5cd2-4625-bc36-47adcbabcf86 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:58.299912 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a2ac7f48-5cd2-4625-bc36-47adcbabcf86 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:58.428113 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a2ac7f48-5cd2-4625-bc36-47adcbabcf86 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:58.435713 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-a2ac7f48-5cd2-4625-bc36-47adcbabcf86 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1681 microversion: 2.1 time: 0.148799 Oct 14 13:02:58.436267 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 179/360] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:58 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:58.503682 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-aecef1ba-9a0d-4c79-bab9-93dc02a373b5 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:58.504293 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-aecef1ba-9a0d-4c79-bab9-93dc02a373b5 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:58.510841 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aecef1ba-9a0d-4c79-bab9-93dc02a373b5 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:58.511325 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aecef1ba-9a0d-4c79-bab9-93dc02a373b5 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:58.511760 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aecef1ba-9a0d-4c79-bab9-93dc02a373b5 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:58.512450 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aecef1ba-9a0d-4c79-bab9-93dc02a373b5 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:58.512901 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aecef1ba-9a0d-4c79-bab9-93dc02a373b5 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:58.513326 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aecef1ba-9a0d-4c79-bab9-93dc02a373b5 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:58.517377 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:02:58.589067 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cd04820f-4a3e-4eaf-84de-7db41c8a8747 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:58.590092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-cd04820f-4a3e-4eaf-84de-7db41c8a8747 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:58.596351 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd04820f-4a3e-4eaf-84de-7db41c8a8747 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:58.596823 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd04820f-4a3e-4eaf-84de-7db41c8a8747 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:58.597248 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd04820f-4a3e-4eaf-84de-7db41c8a8747 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:58.597968 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd04820f-4a3e-4eaf-84de-7db41c8a8747 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:58.598475 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd04820f-4a3e-4eaf-84de-7db41c8a8747 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:58.599409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd04820f-4a3e-4eaf-84de-7db41c8a8747 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:58.646167 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-aecef1ba-9a0d-4c79-bab9-93dc02a373b5 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:58.653850 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-aecef1ba-9a0d-4c79-bab9-93dc02a373b5 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1676 microversion: 2.1 time: 0.154079 Oct 14 13:02:58.654422 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 182/361] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:58 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:58.733114 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-cd04820f-4a3e-4eaf-84de-7db41c8a8747 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:58.741963 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-cd04820f-4a3e-4eaf-84de-7db41c8a8747 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:58.743397 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-cd04820f-4a3e-4eaf-84de-7db41c8a8747 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:58.744581 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-cd04820f-4a3e-4eaf-84de-7db41c8a8747 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.159641 Oct 14 13:02:58.745132 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 180/362] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:58 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:02:59.458627 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d9a7c12e-310f-4f7b-8b2c-f91b8c6c42dc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:59.459230 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-d9a7c12e-310f-4f7b-8b2c-f91b8c6c42dc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:59.465082 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d9a7c12e-310f-4f7b-8b2c-f91b8c6c42dc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:59.465598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d9a7c12e-310f-4f7b-8b2c-f91b8c6c42dc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:59.466031 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d9a7c12e-310f-4f7b-8b2c-f91b8c6c42dc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:59.466703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d9a7c12e-310f-4f7b-8b2c-f91b8c6c42dc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:59.467151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d9a7c12e-310f-4f7b-8b2c-f91b8c6c42dc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:59.467570 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d9a7c12e-310f-4f7b-8b2c-f91b8c6c42dc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:59.596856 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-d9a7c12e-310f-4f7b-8b2c-f91b8c6c42dc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:59.605052 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-d9a7c12e-310f-4f7b-8b2c-f91b8c6c42dc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1681 microversion: 2.1 time: 0.150187 Oct 14 13:02:59.605649 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 183/363] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:59 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:02:59.677900 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-779eba3c-92ff-4e8d-87af-bf554b09b350 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:59.678582 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-779eba3c-92ff-4e8d-87af-bf554b09b350 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:59.684972 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-779eba3c-92ff-4e8d-87af-bf554b09b350 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:59.685530 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-779eba3c-92ff-4e8d-87af-bf554b09b350 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:59.686037 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-779eba3c-92ff-4e8d-87af-bf554b09b350 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:59.686801 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-779eba3c-92ff-4e8d-87af-bf554b09b350 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:59.687319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-779eba3c-92ff-4e8d-87af-bf554b09b350 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:59.688664 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-779eba3c-92ff-4e8d-87af-bf554b09b350 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:59.771455 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7ee73408-52a3-4604-9adf-5556eb709679 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:02:59.772724 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-7ee73408-52a3-4604-9adf-5556eb709679 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:02:59.779711 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7ee73408-52a3-4604-9adf-5556eb709679 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:59.780440 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7ee73408-52a3-4604-9adf-5556eb709679 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:59.781423 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7ee73408-52a3-4604-9adf-5556eb709679 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:59.782695 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7ee73408-52a3-4604-9adf-5556eb709679 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:02:59.783562 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7ee73408-52a3-4604-9adf-5556eb709679 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:02:59.784364 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7ee73408-52a3-4604-9adf-5556eb709679 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:02:59.861214 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-779eba3c-92ff-4e8d-87af-bf554b09b350 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:02:59.869468 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-779eba3c-92ff-4e8d-87af-bf554b09b350 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1676 microversion: 2.1 time: 0.195828 Oct 14 13:02:59.870529 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 181/364] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:02:59 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1676 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:00.109862 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-7ee73408-52a3-4604-9adf-5556eb709679 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:00.119189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-7ee73408-52a3-4604-9adf-5556eb709679 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:00.120634 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-7ee73408-52a3-4604-9adf-5556eb709679 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:00.121820 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7ee73408-52a3-4604-9adf-5556eb709679 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.356177 Oct 14 13:03:00.122370 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 184/365] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:02:59 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:03:00.528749 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2cea95fe-6fbd-4897-8d75-f90218cfed75 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:00.531101 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-2cea95fe-6fbd-4897-8d75-f90218cfed75 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:00.538018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2cea95fe-6fbd-4897-8d75-f90218cfed75 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:00.538514 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2cea95fe-6fbd-4897-8d75-f90218cfed75 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:00.538953 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2cea95fe-6fbd-4897-8d75-f90218cfed75 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:00.539664 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2cea95fe-6fbd-4897-8d75-f90218cfed75 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:00.540123 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2cea95fe-6fbd-4897-8d75-f90218cfed75 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:00.540550 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2cea95fe-6fbd-4897-8d75-f90218cfed75 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:00.564817 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-2cea95fe-6fbd-4897-8d75-f90218cfed75 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lazy-loading 'flavor' on Instance uuid ac1bf768-41b1-41c6-9621-d0aaead003e5 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:03:00.629769 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2d157490-9423-4a5b-8a4d-91618bfde274 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:00.630241 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2d157490-9423-4a5b-8a4d-91618bfde274 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:00.637713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d157490-9423-4a5b-8a4d-91618bfde274 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:00.638201 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d157490-9423-4a5b-8a4d-91618bfde274 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:00.638763 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d157490-9423-4a5b-8a4d-91618bfde274 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:00.639591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d157490-9423-4a5b-8a4d-91618bfde274 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:00.640554 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d157490-9423-4a5b-8a4d-91618bfde274 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:00.641357 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d157490-9423-4a5b-8a4d-91618bfde274 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:00.694132 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:00.702405 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-2cea95fe-6fbd-4897-8d75-f90218cfed75 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "POST /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/action" status: 200 len: 32 microversion: 2.1 time: 0.177633 Oct 14 13:03:00.707772 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 182/366] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Oct 14 13:03:00 2022] POST /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 13:03:00.713778 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-df264f5e-9a72-4d40-b661-2acc33f21414 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:00.716298 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2d157490-9423-4a5b-8a4d-91618bfde274 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:00.721807 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-df264f5e-9a72-4d40-b661-2acc33f21414 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:00.726536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2d157490-9423-4a5b-8a4d-91618bfde274 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1614 microversion: 2.1 time: 0.100022 Oct 14 13:03:00.727751 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 185/367] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:00 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:03:00.743944 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-df264f5e-9a72-4d40-b661-2acc33f21414 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:00.744560 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-df264f5e-9a72-4d40-b661-2acc33f21414 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:00.745191 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-df264f5e-9a72-4d40-b661-2acc33f21414 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:00.746202 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-df264f5e-9a72-4d40-b661-2acc33f21414 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:00.747002 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-df264f5e-9a72-4d40-b661-2acc33f21414 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:00.747433 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-df264f5e-9a72-4d40-b661-2acc33f21414 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:00.851416 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-a236a9c7-b6bf-470a-a300-9370de57fc7c req-6cedbb34-bc0f-4af8-809d-4f3dda629885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fe0d2ae-312a-4c18-96d6-ae8d86372eee", "name": "network-vif-deleted", "tag": "f683cd87-b2e8-44df-bb14-216087a69181"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:00.863809 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-a236a9c7-b6bf-470a-a300-9370de57fc7c req-6cedbb34-bc0f-4af8-809d-4f3dda629885 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:00.864637 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-a236a9c7-b6bf-470a-a300-9370de57fc7c req-6cedbb34-bc0f-4af8-809d-4f3dda629885 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:00.865282 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-a236a9c7-b6bf-470a-a300-9370de57fc7c req-6cedbb34-bc0f-4af8-809d-4f3dda629885 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:00.884983 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-a236a9c7-b6bf-470a-a300-9370de57fc7c req-6cedbb34-bc0f-4af8-809d-4f3dda629885 service nova] Creating event network-vif-deleted:f683cd87-b2e8-44df-bb14-216087a69181 for instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee on hv-cinder-82099 Oct 14 13:03:00.891017 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-a236a9c7-b6bf-470a-a300-9370de57fc7c req-6cedbb34-bc0f-4af8-809d-4f3dda629885 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045221 Oct 14 13:03:00.892681 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 186/368] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:03:00.899547 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7f7a5b0d-c31c-468b-82e7-18bc3bd4535b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:00.900438 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-7f7a5b0d-c31c-468b-82e7-18bc3bd4535b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:00.907476 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7f7a5b0d-c31c-468b-82e7-18bc3bd4535b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:00.908232 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7f7a5b0d-c31c-468b-82e7-18bc3bd4535b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:00.908841 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7f7a5b0d-c31c-468b-82e7-18bc3bd4535b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:00.910523 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7f7a5b0d-c31c-468b-82e7-18bc3bd4535b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:00.911979 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7f7a5b0d-c31c-468b-82e7-18bc3bd4535b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:00.912584 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7f7a5b0d-c31c-468b-82e7-18bc3bd4535b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:01.040141 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-df264f5e-9a72-4d40-b661-2acc33f21414 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:01.051987 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-df264f5e-9a72-4d40-b661-2acc33f21414 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.342820 Oct 14 13:03:01.056284 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 183/369] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:00 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:01.088009 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-7f7a5b0d-c31c-468b-82e7-18bc3bd4535b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:01.096343 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7f7a5b0d-c31c-468b-82e7-18bc3bd4535b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1676 microversion: 2.1 time: 0.202137 Oct 14 13:03:01.096920 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 187/370] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:00 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1676 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:01.148122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f5d5c986-8488-4fbf-8e51-3cba46facad2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:01.148729 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f5d5c986-8488-4fbf-8e51-3cba46facad2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:01.156009 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f5d5c986-8488-4fbf-8e51-3cba46facad2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:01.156706 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f5d5c986-8488-4fbf-8e51-3cba46facad2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:01.157314 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f5d5c986-8488-4fbf-8e51-3cba46facad2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:01.158203 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f5d5c986-8488-4fbf-8e51-3cba46facad2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:01.158817 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f5d5c986-8488-4fbf-8e51-3cba46facad2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:01.159376 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f5d5c986-8488-4fbf-8e51-3cba46facad2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:01.345162 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f5d5c986-8488-4fbf-8e51-3cba46facad2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:01.353888 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f5d5c986-8488-4fbf-8e51-3cba46facad2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:01.355723 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f5d5c986-8488-4fbf-8e51-3cba46facad2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:01.357422 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-f5d5c986-8488-4fbf-8e51-3cba46facad2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.213776 Oct 14 13:03:01.358161 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 184/371] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:01 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:03:01.751603 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-cb277189-964d-4b5d-86a2-f0e4ee5c7229 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:01.752326 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-cb277189-964d-4b5d-86a2-f0e4ee5c7229 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:01.760094 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cb277189-964d-4b5d-86a2-f0e4ee5c7229 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:01.760729 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cb277189-964d-4b5d-86a2-f0e4ee5c7229 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:01.761277 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cb277189-964d-4b5d-86a2-f0e4ee5c7229 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:01.762193 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cb277189-964d-4b5d-86a2-f0e4ee5c7229 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:01.762779 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cb277189-964d-4b5d-86a2-f0e4ee5c7229 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:01.763302 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cb277189-964d-4b5d-86a2-f0e4ee5c7229 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:01.797667 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cb277189-964d-4b5d-86a2-f0e4ee5c7229 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:01.798341 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cb277189-964d-4b5d-86a2-f0e4ee5c7229 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:01.799036 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cb277189-964d-4b5d-86a2-f0e4ee5c7229 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:01.799643 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.objects.instance [None req-cb277189-964d-4b5d-86a2-f0e4ee5c7229 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lazy-loading 'fault' on Instance uuid 5fe0d2ae-312a-4c18-96d6-ae8d86372eee {{(pid=118868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:03:01.849176 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-cb277189-964d-4b5d-86a2-f0e4ee5c7229 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:01.857601 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-cb277189-964d-4b5d-86a2-f0e4ee5c7229 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 200 len: 1332 microversion: 2.1 time: 0.110000 Oct 14 13:03:01.858378 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 188/372] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:01 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 1332 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:03:02.081657 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-43b9b375-e80b-4c7a-a5a3-88c6c439aa18 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:02.083139 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-43b9b375-e80b-4c7a-a5a3-88c6c439aa18 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:02.099823 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-43b9b375-e80b-4c7a-a5a3-88c6c439aa18 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:02.100309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-43b9b375-e80b-4c7a-a5a3-88c6c439aa18 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:02.100920 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-43b9b375-e80b-4c7a-a5a3-88c6c439aa18 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:02.101796 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-43b9b375-e80b-4c7a-a5a3-88c6c439aa18 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:02.102525 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-43b9b375-e80b-4c7a-a5a3-88c6c439aa18 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:02.103126 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-43b9b375-e80b-4c7a-a5a3-88c6c439aa18 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:02.123381 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-075e32fb-a61b-450d-a544-aedc1270b625 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:02.124495 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-075e32fb-a61b-450d-a544-aedc1270b625 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:02.134152 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-075e32fb-a61b-450d-a544-aedc1270b625 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:02.134646 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-075e32fb-a61b-450d-a544-aedc1270b625 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:02.135079 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-075e32fb-a61b-450d-a544-aedc1270b625 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:02.135770 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-075e32fb-a61b-450d-a544-aedc1270b625 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:02.136218 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-075e32fb-a61b-450d-a544-aedc1270b625 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:02.136636 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-075e32fb-a61b-450d-a544-aedc1270b625 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:02.323889 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-075e32fb-a61b-450d-a544-aedc1270b625 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:02.334473 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-075e32fb-a61b-450d-a544-aedc1270b625 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1676 microversion: 2.1 time: 0.217542 Oct 14 13:03:02.335284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 189/373] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:02 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:03:02.384445 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-08584e52-1663-42f6-b16a-ca667caa1113 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:02.385611 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-08584e52-1663-42f6-b16a-ca667caa1113 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:02.388566 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-43b9b375-e80b-4c7a-a5a3-88c6c439aa18 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:02.392222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-08584e52-1663-42f6-b16a-ca667caa1113 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:02.393334 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-08584e52-1663-42f6-b16a-ca667caa1113 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:02.393827 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-08584e52-1663-42f6-b16a-ca667caa1113 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:02.394553 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-08584e52-1663-42f6-b16a-ca667caa1113 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:02.395046 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-08584e52-1663-42f6-b16a-ca667caa1113 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:02.395966 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-08584e52-1663-42f6-b16a-ca667caa1113 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:02.399685 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-43b9b375-e80b-4c7a-a5a3-88c6c439aa18 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.322072 Oct 14 13:03:02.400659 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 185/374] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:02 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:02.530877 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-08584e52-1663-42f6-b16a-ca667caa1113 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:02.539479 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-08584e52-1663-42f6-b16a-ca667caa1113 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:02.540936 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-08584e52-1663-42f6-b16a-ca667caa1113 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:02.542140 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-08584e52-1663-42f6-b16a-ca667caa1113 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.162465 Oct 14 13:03:02.543313 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 190/375] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:02 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:03:02.881598 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cda439df-3275-4475-a2a8-162c819496c0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:02.882198 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-cda439df-3275-4475-a2a8-162c819496c0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:02.888324 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cda439df-3275-4475-a2a8-162c819496c0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:02.888742 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cda439df-3275-4475-a2a8-162c819496c0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:02.889195 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cda439df-3275-4475-a2a8-162c819496c0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:02.889906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cda439df-3275-4475-a2a8-162c819496c0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:02.890357 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cda439df-3275-4475-a2a8-162c819496c0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:02.890773 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cda439df-3275-4475-a2a8-162c819496c0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:02.904192 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-cda439df-3275-4475-a2a8-162c819496c0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] HTTP exception thrown: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cda439df-3275-4475-a2a8-162c819496c0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Request method failure captured: Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee HTTP/1.1 Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1FViMK-WvBvO8SLI8drD1UcXlTPANFWG-ZTvaw7ModKJdGRWngdLI5cp6n7bXZ7oPe4LkLOonqm901dlPL1Z_CDQlnflfzMT4YPNiiBNZ_K890mBj2sVo-ptm5duO44Ujpzx_OuaK4ZxTnFio58yttRWo_3AshSXsX0p_7cyovml4 Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:03:02.905820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:03:02.907108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c0d083e8cef4333b9514d2256991647", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:03:02.907108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:03:02.907108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:03:02.907108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:03:02.907108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:03:02.907108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:03:02.907108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:03:02.907108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 0bcbf6513b6a4df3b044fadfb7888d54 Oct 14 13:03:02.907108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:03:02.907108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:03:02.907108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. Oct 14 13:03:02.907108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '5fe0d2ae-312a-4c18-96d6-ae8d86372eee'} Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:03:02.908567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. Oct 14 13:03:02.910023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:03:02.911871 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cda439df-3275-4475-a2a8-162c819496c0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Returning 404 to user: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:03:02.911871 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-cda439df-3275-4475-a2a8-162c819496c0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 404 len: 111 microversion: 2.1 time: 0.029520 Oct 14 13:03:02.911871 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 186/376] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:02 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:03:02.916650 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-57adc531-941a-49ce-993b-41ee29b70205 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '.version_select at 0x7fbb81bbdb80>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:02.937217 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-57adc531-941a-49ce-993b-41ee29b70205 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619541885" status: 202 len: 0 microversion: 2.1 time: 0.024454 Oct 14 13:03:02.937915 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 191/377] 10.222.0.47 () {58 vars in 1221 bytes} [Fri Oct 14 13:03:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619541885 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:03:03.358484 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ebaf496d-f429-488c-a5fa-7d937bdf455e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:03.359242 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ebaf496d-f429-488c-a5fa-7d937bdf455e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:03.365450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ebaf496d-f429-488c-a5fa-7d937bdf455e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:03.365971 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ebaf496d-f429-488c-a5fa-7d937bdf455e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:03.366409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ebaf496d-f429-488c-a5fa-7d937bdf455e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:03.367097 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ebaf496d-f429-488c-a5fa-7d937bdf455e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:03.367553 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ebaf496d-f429-488c-a5fa-7d937bdf455e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:03.367980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ebaf496d-f429-488c-a5fa-7d937bdf455e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:03.422745 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-307cd22e-ce67-4b2a-bec8-02c9e764bd5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:03.423446 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-307cd22e-ce67-4b2a-bec8-02c9e764bd5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:03.430871 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-307cd22e-ce67-4b2a-bec8-02c9e764bd5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:03.432424 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-307cd22e-ce67-4b2a-bec8-02c9e764bd5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:03.432967 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-307cd22e-ce67-4b2a-bec8-02c9e764bd5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:03.433820 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-307cd22e-ce67-4b2a-bec8-02c9e764bd5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:03.435090 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-307cd22e-ce67-4b2a-bec8-02c9e764bd5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:03.435579 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-307cd22e-ce67-4b2a-bec8-02c9e764bd5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:03.553959 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ebaf496d-f429-488c-a5fa-7d937bdf455e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:03.563473 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ebaf496d-f429-488c-a5fa-7d937bdf455e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1676 microversion: 2.1 time: 0.208892 Oct 14 13:03:03.574280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 187/378] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:03 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1676 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:03.577959 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-307cd22e-ce67-4b2a-bec8-02c9e764bd5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:03.589250 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-307cd22e-ce67-4b2a-bec8-02c9e764bd5e tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.170406 Oct 14 13:03:03.590578 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 192/379] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:03 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:03:03.603941 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4bfbc614-1906-4e57-9fde-0918d3cffca9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:03.604880 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4bfbc614-1906-4e57-9fde-0918d3cffca9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:03.611625 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4bfbc614-1906-4e57-9fde-0918d3cffca9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:03.612258 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4bfbc614-1906-4e57-9fde-0918d3cffca9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:03.612797 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4bfbc614-1906-4e57-9fde-0918d3cffca9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:03.614071 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4bfbc614-1906-4e57-9fde-0918d3cffca9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:03.614709 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4bfbc614-1906-4e57-9fde-0918d3cffca9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:03.614955 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4bfbc614-1906-4e57-9fde-0918d3cffca9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:03.763741 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-15d06e86-1ce8-414f-a4ab-39e34f0da269 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:03.764325 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-15d06e86-1ce8-414f-a4ab-39e34f0da269 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:03.764992 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4bfbc614-1906-4e57-9fde-0918d3cffca9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:03.770255 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-15d06e86-1ce8-414f-a4ab-39e34f0da269 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:03.770743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-15d06e86-1ce8-414f-a4ab-39e34f0da269 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:03.771172 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-15d06e86-1ce8-414f-a4ab-39e34f0da269 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:03.771857 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-15d06e86-1ce8-414f-a4ab-39e34f0da269 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:03.772304 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-15d06e86-1ce8-414f-a4ab-39e34f0da269 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:03.772721 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-15d06e86-1ce8-414f-a4ab-39e34f0da269 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:03.773707 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4bfbc614-1906-4e57-9fde-0918d3cffca9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:03.775154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4bfbc614-1906-4e57-9fde-0918d3cffca9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:03.776297 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4bfbc614-1906-4e57-9fde-0918d3cffca9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.192556 Oct 14 13:03:03.776844 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 188/380] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:03 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:03:03.896799 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.objects.instance [None req-15d06e86-1ce8-414f-a4ab-39e34f0da269 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lazy-loading 'services' on Instance uuid defcc0c0-d0f4-4913-899d-4d20b75896d6 {{(pid=118868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:03:04.005378 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-15d06e86-1ce8-414f-a4ab-39e34f0da269 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "DELETE /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6/os-volume_attachments/3a930cf3-00fb-42d3-8326-97367f550838" status: 202 len: 0 microversion: 2.1 time: 0.244787 Oct 14 13:03:04.005996 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 193/381] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Oct 14 13:03:03 2022] DELETE /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6/os-volume_attachments/3a930cf3-00fb-42d3-8326-97367f550838 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 13:03:04.014274 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0e80fc87-348c-4a41-9a7a-1d09edd4c7b1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:04.016475 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-0e80fc87-348c-4a41-9a7a-1d09edd4c7b1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:04.022949 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0e80fc87-348c-4a41-9a7a-1d09edd4c7b1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:04.023594 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0e80fc87-348c-4a41-9a7a-1d09edd4c7b1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:04.024109 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0e80fc87-348c-4a41-9a7a-1d09edd4c7b1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:04.024803 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0e80fc87-348c-4a41-9a7a-1d09edd4c7b1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:04.025252 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0e80fc87-348c-4a41-9a7a-1d09edd4c7b1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:04.025694 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0e80fc87-348c-4a41-9a7a-1d09edd4c7b1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:04.055701 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-0e80fc87-348c-4a41-9a7a-1d09edd4c7b1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045309 Oct 14 13:03:04.056238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 189/382] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:03:04 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:03:04.589256 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5f97ee82-2af6-41df-be6e-7845e28ccb87 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:04.589975 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5f97ee82-2af6-41df-be6e-7845e28ccb87 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:04.596198 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5f97ee82-2af6-41df-be6e-7845e28ccb87 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:04.596683 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5f97ee82-2af6-41df-be6e-7845e28ccb87 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:04.597120 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5f97ee82-2af6-41df-be6e-7845e28ccb87 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:04.597835 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5f97ee82-2af6-41df-be6e-7845e28ccb87 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:04.598881 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5f97ee82-2af6-41df-be6e-7845e28ccb87 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:04.599309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5f97ee82-2af6-41df-be6e-7845e28ccb87 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:04.612355 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-dde052c6-c63f-4a44-85e5-719f2e5b9076 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:04.612952 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-dde052c6-c63f-4a44-85e5-719f2e5b9076 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:04.619515 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dde052c6-c63f-4a44-85e5-719f2e5b9076 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:04.619819 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dde052c6-c63f-4a44-85e5-719f2e5b9076 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:04.620433 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dde052c6-c63f-4a44-85e5-719f2e5b9076 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:04.621118 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dde052c6-c63f-4a44-85e5-719f2e5b9076 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:04.621748 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dde052c6-c63f-4a44-85e5-719f2e5b9076 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:04.622167 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dde052c6-c63f-4a44-85e5-719f2e5b9076 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:04.735818 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5f97ee82-2af6-41df-be6e-7845e28ccb87 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:04.743492 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5f97ee82-2af6-41df-be6e-7845e28ccb87 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1676 microversion: 2.1 time: 0.158540 Oct 14 13:03:04.744060 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 194/383] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:04 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:04.754398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-dde052c6-c63f-4a44-85e5-719f2e5b9076 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:04.762748 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-dde052c6-c63f-4a44-85e5-719f2e5b9076 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.154493 Oct 14 13:03:04.763396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 190/384] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:04 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:03:04.801658 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1f9b9ccf-4488-49f1-b32e-a467fa27b3bd tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:04.802254 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1f9b9ccf-4488-49f1-b32e-a467fa27b3bd tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:04.809090 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f9b9ccf-4488-49f1-b32e-a467fa27b3bd tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:04.809597 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f9b9ccf-4488-49f1-b32e-a467fa27b3bd tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:04.810025 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f9b9ccf-4488-49f1-b32e-a467fa27b3bd tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:04.810707 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f9b9ccf-4488-49f1-b32e-a467fa27b3bd tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:04.811163 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f9b9ccf-4488-49f1-b32e-a467fa27b3bd tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:04.811579 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f9b9ccf-4488-49f1-b32e-a467fa27b3bd tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:04.953256 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-1f9b9ccf-4488-49f1-b32e-a467fa27b3bd tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:04.962446 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-1f9b9ccf-4488-49f1-b32e-a467fa27b3bd tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:04.963900 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-1f9b9ccf-4488-49f1-b32e-a467fa27b3bd tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:04.965078 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1f9b9ccf-4488-49f1-b32e-a467fa27b3bd tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.167445 Oct 14 13:03:04.965697 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 195/385] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:04 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:03:05.065703 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-ef7ef5af-78b5-4b46-9cb5-efca60deb858 req-fc996d99-f00a-4bf1-9315-86d67989de20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f2bb08-a11d-46c6-96f5-9a9f85316fd0", "name": "network-vif-plugged", "status": "completed", "tag": "e3f9c588-4549-470d-90da-07db69916332"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:05.068881 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-81d73f13-5ee3-4a82-9f59-a4fb896450e6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:05.071143 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-81d73f13-5ee3-4a82-9f59-a4fb896450e6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:05.075997 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-ef7ef5af-78b5-4b46-9cb5-efca60deb858 req-fc996d99-f00a-4bf1-9315-86d67989de20 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:05.076620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-ef7ef5af-78b5-4b46-9cb5-efca60deb858 req-fc996d99-f00a-4bf1-9315-86d67989de20 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:05.077060 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-ef7ef5af-78b5-4b46-9cb5-efca60deb858 req-fc996d99-f00a-4bf1-9315-86d67989de20 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:05.077437 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-81d73f13-5ee3-4a82-9f59-a4fb896450e6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:05.078310 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-81d73f13-5ee3-4a82-9f59-a4fb896450e6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:05.078803 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-81d73f13-5ee3-4a82-9f59-a4fb896450e6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:05.079704 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-81d73f13-5ee3-4a82-9f59-a4fb896450e6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:05.080159 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-81d73f13-5ee3-4a82-9f59-a4fb896450e6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:05.080576 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-81d73f13-5ee3-4a82-9f59-a4fb896450e6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:05.089343 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-ef7ef5af-78b5-4b46-9cb5-efca60deb858 req-fc996d99-f00a-4bf1-9315-86d67989de20 service nova] Creating event network-vif-plugged:e3f9c588-4549-470d-90da-07db69916332 for instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 on hv-cinder-82099 Oct 14 13:03:05.094306 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-ef7ef5af-78b5-4b46-9cb5-efca60deb858 req-fc996d99-f00a-4bf1-9315-86d67989de20 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032513 Oct 14 13:03:05.094893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 191/386] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:03:05.115050 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-81d73f13-5ee3-4a82-9f59-a4fb896450e6 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050749 Oct 14 13:03:05.115717 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 196/387] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:03:05 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 14 13:03:05.192765 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-fc1c4f09-b3bd-41a7-8fc6-76e5fcb2e750 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:05.193380 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-fc1c4f09-b3bd-41a7-8fc6-76e5fcb2e750 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:05.199550 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc1c4f09-b3bd-41a7-8fc6-76e5fcb2e750 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:05.200029 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc1c4f09-b3bd-41a7-8fc6-76e5fcb2e750 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:05.200461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc1c4f09-b3bd-41a7-8fc6-76e5fcb2e750 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:05.201144 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc1c4f09-b3bd-41a7-8fc6-76e5fcb2e750 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:05.201632 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc1c4f09-b3bd-41a7-8fc6-76e5fcb2e750 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:05.202056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc1c4f09-b3bd-41a7-8fc6-76e5fcb2e750 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:05.226607 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-fc1c4f09-b3bd-41a7-8fc6-76e5fcb2e750 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Going to try to terminate instance {{(pid=118869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:03:05.299379 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-fc1c4f09-b3bd-41a7-8fc6-76e5fcb2e750 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "DELETE /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 204 len: 0 microversion: 2.1 time: 0.111875 Oct 14 13:03:05.299859 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 192/388] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:03:05 2022] DELETE /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:03:05.308469 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-81b259ce-01ba-4752-9627-8ce0cf049f62 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:05.309073 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-81b259ce-01ba-4752-9627-8ce0cf049f62 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:05.314860 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-81b259ce-01ba-4752-9627-8ce0cf049f62 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:05.315338 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-81b259ce-01ba-4752-9627-8ce0cf049f62 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:05.315766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-81b259ce-01ba-4752-9627-8ce0cf049f62 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:05.316437 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-81b259ce-01ba-4752-9627-8ce0cf049f62 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:05.317554 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-81b259ce-01ba-4752-9627-8ce0cf049f62 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:05.317976 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-81b259ce-01ba-4752-9627-8ce0cf049f62 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:05.444275 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-81b259ce-01ba-4752-9627-8ce0cf049f62 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:05.451853 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-81b259ce-01ba-4752-9627-8ce0cf049f62 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1679 microversion: 2.1 time: 0.147168 Oct 14 13:03:05.452416 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 197/389] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:05 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:05.767490 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ecd8fbcd-6d21-4bd4-86c8-3e7ed776d140 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:05.768119 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ecd8fbcd-6d21-4bd4-86c8-3e7ed776d140 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:05.774112 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ecd8fbcd-6d21-4bd4-86c8-3e7ed776d140 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:05.774593 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ecd8fbcd-6d21-4bd4-86c8-3e7ed776d140 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:05.775024 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ecd8fbcd-6d21-4bd4-86c8-3e7ed776d140 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:05.775708 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ecd8fbcd-6d21-4bd4-86c8-3e7ed776d140 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:05.776157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ecd8fbcd-6d21-4bd4-86c8-3e7ed776d140 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:05.776584 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ecd8fbcd-6d21-4bd4-86c8-3e7ed776d140 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:05.786578 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2d07837d-7f78-4bea-a871-a7970853c401 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:05.787186 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2d07837d-7f78-4bea-a871-a7970853c401 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:05.793406 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d07837d-7f78-4bea-a871-a7970853c401 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:05.793925 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d07837d-7f78-4bea-a871-a7970853c401 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:05.794360 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d07837d-7f78-4bea-a871-a7970853c401 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:05.795052 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d07837d-7f78-4bea-a871-a7970853c401 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:05.795502 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d07837d-7f78-4bea-a871-a7970853c401 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:05.795925 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d07837d-7f78-4bea-a871-a7970853c401 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:05.909726 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ecd8fbcd-6d21-4bd4-86c8-3e7ed776d140 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:05.917919 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ecd8fbcd-6d21-4bd4-86c8-3e7ed776d140 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1676 microversion: 2.1 time: 0.154766 Oct 14 13:03:05.918481 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 193/390] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:05 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:05.930302 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2d07837d-7f78-4bea-a871-a7970853c401 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:05.939028 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2d07837d-7f78-4bea-a871-a7970853c401 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.156749 Oct 14 13:03:05.939587 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 198/391] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:05 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:03:05.991073 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e37eac44-7aec-494d-b54c-cfcb66048538 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:05.991678 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e37eac44-7aec-494d-b54c-cfcb66048538 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:05.997627 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e37eac44-7aec-494d-b54c-cfcb66048538 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:05.998109 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e37eac44-7aec-494d-b54c-cfcb66048538 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:05.998536 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e37eac44-7aec-494d-b54c-cfcb66048538 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:05.999220 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e37eac44-7aec-494d-b54c-cfcb66048538 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:05.999667 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e37eac44-7aec-494d-b54c-cfcb66048538 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:06.000089 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e37eac44-7aec-494d-b54c-cfcb66048538 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:06.124762 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e37eac44-7aec-494d-b54c-cfcb66048538 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:06.133313 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e37eac44-7aec-494d-b54c-cfcb66048538 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:06.134798 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e37eac44-7aec-494d-b54c-cfcb66048538 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:06.135951 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e37eac44-7aec-494d-b54c-cfcb66048538 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.149346 Oct 14 13:03:06.136502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 194/392] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:05 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:03:06.474890 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6553bb78-16e0-4ef0-a065-a54bc4b50530 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:06.475506 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-6553bb78-16e0-4ef0-a065-a54bc4b50530 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:06.481580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6553bb78-16e0-4ef0-a065-a54bc4b50530 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:06.482064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6553bb78-16e0-4ef0-a065-a54bc4b50530 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:06.482498 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6553bb78-16e0-4ef0-a065-a54bc4b50530 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:06.483189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6553bb78-16e0-4ef0-a065-a54bc4b50530 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:06.483646 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6553bb78-16e0-4ef0-a065-a54bc4b50530 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:06.484069 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6553bb78-16e0-4ef0-a065-a54bc4b50530 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:06.502157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:06.613515 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-6553bb78-16e0-4ef0-a065-a54bc4b50530 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:06.621223 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-6553bb78-16e0-4ef0-a065-a54bc4b50530 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1679 microversion: 2.1 time: 0.150313 Oct 14 13:03:06.621827 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 199/393] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:06 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:06.941537 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-699c0664-f0d9-4b83-8140-5e15aeab18d6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:06.942686 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-699c0664-f0d9-4b83-8140-5e15aeab18d6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:06.949018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-699c0664-f0d9-4b83-8140-5e15aeab18d6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:06.949510 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-699c0664-f0d9-4b83-8140-5e15aeab18d6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:06.949940 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-699c0664-f0d9-4b83-8140-5e15aeab18d6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:06.950616 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-699c0664-f0d9-4b83-8140-5e15aeab18d6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:06.951061 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-699c0664-f0d9-4b83-8140-5e15aeab18d6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:06.951478 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-699c0664-f0d9-4b83-8140-5e15aeab18d6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:06.961693 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4f4244e8-5dd5-4a3b-a793-de65038be191 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:06.962310 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-4f4244e8-5dd5-4a3b-a793-de65038be191 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:06.969377 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4f4244e8-5dd5-4a3b-a793-de65038be191 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:06.969942 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4f4244e8-5dd5-4a3b-a793-de65038be191 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:06.970408 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4f4244e8-5dd5-4a3b-a793-de65038be191 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:06.971103 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4f4244e8-5dd5-4a3b-a793-de65038be191 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:06.971625 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4f4244e8-5dd5-4a3b-a793-de65038be191 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:06.972055 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4f4244e8-5dd5-4a3b-a793-de65038be191 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:07.106452 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-4f4244e8-5dd5-4a3b-a793-de65038be191 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:07.114356 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-699c0664-f0d9-4b83-8140-5e15aeab18d6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:07.115633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4f4244e8-5dd5-4a3b-a793-de65038be191 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.157852 Oct 14 13:03:07.124838 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 200/394] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:06 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:03:07.124989 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-699c0664-f0d9-4b83-8140-5e15aeab18d6 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1676 microversion: 2.1 time: 0.184765 Oct 14 13:03:07.124989 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 195/395] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:06 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1676 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:07.162677 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-3e2cf2ed-b4b9-4b33-bbf7-2ceb633a5850 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:07.163405 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-3e2cf2ed-b4b9-4b33-bbf7-2ceb633a5850 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:07.169272 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e2cf2ed-b4b9-4b33-bbf7-2ceb633a5850 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:07.169782 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e2cf2ed-b4b9-4b33-bbf7-2ceb633a5850 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:07.170211 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e2cf2ed-b4b9-4b33-bbf7-2ceb633a5850 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:07.170885 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e2cf2ed-b4b9-4b33-bbf7-2ceb633a5850 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:07.171330 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e2cf2ed-b4b9-4b33-bbf7-2ceb633a5850 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:07.171749 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e2cf2ed-b4b9-4b33-bbf7-2ceb633a5850 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:07.303996 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3e2cf2ed-b4b9-4b33-bbf7-2ceb633a5850 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:07.312528 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3e2cf2ed-b4b9-4b33-bbf7-2ceb633a5850 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:07.314012 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3e2cf2ed-b4b9-4b33-bbf7-2ceb633a5850 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:07.315165 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-3e2cf2ed-b4b9-4b33-bbf7-2ceb633a5850 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.156966 Oct 14 13:03:07.315716 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 201/396] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:07 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:03:07.644205 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-1f38a359-6b7b-4bd5-ade4-d0de3a2cdbca tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:07.644808 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-1f38a359-6b7b-4bd5-ade4-d0de3a2cdbca tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:07.651788 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1f38a359-6b7b-4bd5-ade4-d0de3a2cdbca tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:07.651788 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1f38a359-6b7b-4bd5-ade4-d0de3a2cdbca tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:07.652242 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1f38a359-6b7b-4bd5-ade4-d0de3a2cdbca tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:07.652927 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1f38a359-6b7b-4bd5-ade4-d0de3a2cdbca tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:07.653371 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1f38a359-6b7b-4bd5-ade4-d0de3a2cdbca tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:07.653815 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1f38a359-6b7b-4bd5-ade4-d0de3a2cdbca tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:08.100100 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-1f38a359-6b7b-4bd5-ade4-d0de3a2cdbca tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:08.107923 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-1f38a359-6b7b-4bd5-ade4-d0de3a2cdbca tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1679 microversion: 2.1 time: 0.467533 Oct 14 13:03:08.108496 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 196/397] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:07 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1679 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:08.138770 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ab64f262-fa91-4a63-90e2-2ce9bcffd659 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:08.139382 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-ab64f262-fa91-4a63-90e2-2ce9bcffd659 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:08.144013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-50543d89-1cf7-4667-89df-63adf9574524 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:08.144626 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-50543d89-1cf7-4667-89df-63adf9574524 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:08.146300 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab64f262-fa91-4a63-90e2-2ce9bcffd659 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:08.147047 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab64f262-fa91-4a63-90e2-2ce9bcffd659 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:08.147428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab64f262-fa91-4a63-90e2-2ce9bcffd659 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:08.148223 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab64f262-fa91-4a63-90e2-2ce9bcffd659 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:08.148750 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab64f262-fa91-4a63-90e2-2ce9bcffd659 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:08.149185 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab64f262-fa91-4a63-90e2-2ce9bcffd659 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:08.150983 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-50543d89-1cf7-4667-89df-63adf9574524 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:08.151470 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-50543d89-1cf7-4667-89df-63adf9574524 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:08.151911 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-50543d89-1cf7-4667-89df-63adf9574524 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:08.152688 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-50543d89-1cf7-4667-89df-63adf9574524 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:08.153129 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-50543d89-1cf7-4667-89df-63adf9574524 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:08.153589 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-50543d89-1cf7-4667-89df-63adf9574524 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:08.284408 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ab64f262-fa91-4a63-90e2-2ce9bcffd659 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:08.294796 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ab64f262-fa91-4a63-90e2-2ce9bcffd659 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.159898 Oct 14 13:03:08.295366 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 202/398] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:08 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:08.340369 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-a0c8ecd4-663f-45e8-bd79-593ea14bafdf tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:08.340976 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-a0c8ecd4-663f-45e8-bd79-593ea14bafdf tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:08.347432 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a0c8ecd4-663f-45e8-bd79-593ea14bafdf tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:08.347846 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a0c8ecd4-663f-45e8-bd79-593ea14bafdf tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:08.348897 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a0c8ecd4-663f-45e8-bd79-593ea14bafdf tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:08.349616 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a0c8ecd4-663f-45e8-bd79-593ea14bafdf tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:08.350065 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a0c8ecd4-663f-45e8-bd79-593ea14bafdf tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:08.350488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a0c8ecd4-663f-45e8-bd79-593ea14bafdf tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:08.402419 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-50543d89-1cf7-4667-89df-63adf9574524 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:08.415961 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-50543d89-1cf7-4667-89df-63adf9574524 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1676 microversion: 2.1 time: 0.275712 Oct 14 13:03:08.416536 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 197/399] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:08 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1676 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:08.524280 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-a0c8ecd4-663f-45e8-bd79-593ea14bafdf tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:08.534010 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-a0c8ecd4-663f-45e8-bd79-593ea14bafdf tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:08.536269 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-a0c8ecd4-663f-45e8-bd79-593ea14bafdf tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:08.537446 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-a0c8ecd4-663f-45e8-bd79-593ea14bafdf tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1809 microversion: 2.20 time: 0.201247 Oct 14 13:03:08.538029 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 203/400] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:08 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:03:08.676854 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-eaf838b6-0935-4cdd-8023-5b0feacaa969 req-e544e9f3-b162-46b8-932f-1bf7f388f8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "defcc0c0-d0f4-4913-899d-4d20b75896d6", "name": "network-vif-deleted", "tag": "1f5e8c9c-50a5-47d9-a8b7-c42df0f5a568"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:08.691273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-eaf838b6-0935-4cdd-8023-5b0feacaa969 req-e544e9f3-b162-46b8-932f-1bf7f388f8a0 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:08.692985 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-eaf838b6-0935-4cdd-8023-5b0feacaa969 req-e544e9f3-b162-46b8-932f-1bf7f388f8a0 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:08.693805 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-eaf838b6-0935-4cdd-8023-5b0feacaa969 req-e544e9f3-b162-46b8-932f-1bf7f388f8a0 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:08.706872 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-eaf838b6-0935-4cdd-8023-5b0feacaa969 req-e544e9f3-b162-46b8-932f-1bf7f388f8a0 service nova] Creating event network-vif-deleted:1f5e8c9c-50a5-47d9-a8b7-c42df0f5a568 for instance defcc0c0-d0f4-4913-899d-4d20b75896d6 on hv-cinder-82099 Oct 14 13:03:08.714477 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-eaf838b6-0935-4cdd-8023-5b0feacaa969 req-e544e9f3-b162-46b8-932f-1bf7f388f8a0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047726 Oct 14 13:03:08.715877 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 198/401] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:03:09.132237 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-436dfafb-0d04-4a70-a358-fdca3d539451 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:09.132924 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-436dfafb-0d04-4a70-a358-fdca3d539451 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:09.139437 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-436dfafb-0d04-4a70-a358-fdca3d539451 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:09.140672 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-436dfafb-0d04-4a70-a358-fdca3d539451 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:09.141285 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-436dfafb-0d04-4a70-a358-fdca3d539451 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:09.142179 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-436dfafb-0d04-4a70-a358-fdca3d539451 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:09.142800 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-436dfafb-0d04-4a70-a358-fdca3d539451 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:09.143384 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-436dfafb-0d04-4a70-a358-fdca3d539451 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:09.184488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-436dfafb-0d04-4a70-a358-fdca3d539451 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:09.185320 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-436dfafb-0d04-4a70-a358-fdca3d539451 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:09.186019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-436dfafb-0d04-4a70-a358-fdca3d539451 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:09.186506 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.objects.instance [None req-436dfafb-0d04-4a70-a358-fdca3d539451 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lazy-loading 'fault' on Instance uuid defcc0c0-d0f4-4913-899d-4d20b75896d6 {{(pid=118868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:03:09.229374 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-436dfafb-0d04-4a70-a358-fdca3d539451 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:09.237999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-436dfafb-0d04-4a70-a358-fdca3d539451 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 200 len: 1330 microversion: 2.1 time: 0.110070 Oct 14 13:03:09.239269 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 204/402] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:09 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:09.320168 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e03f5408-0563-4603-abb9-fad44f6e587b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:09.321237 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e03f5408-0563-4603-abb9-fad44f6e587b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:09.327414 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e03f5408-0563-4603-abb9-fad44f6e587b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:09.327976 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e03f5408-0563-4603-abb9-fad44f6e587b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:09.328479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e03f5408-0563-4603-abb9-fad44f6e587b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:09.329247 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e03f5408-0563-4603-abb9-fad44f6e587b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:09.329791 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e03f5408-0563-4603-abb9-fad44f6e587b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:09.330277 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e03f5408-0563-4603-abb9-fad44f6e587b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:09.439698 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7be6c192-ec96-41ae-b525-614ddd149940 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:09.440695 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-7be6c192-ec96-41ae-b525-614ddd149940 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:09.457792 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7be6c192-ec96-41ae-b525-614ddd149940 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:09.459803 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7be6c192-ec96-41ae-b525-614ddd149940 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:09.460636 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7be6c192-ec96-41ae-b525-614ddd149940 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:09.462351 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7be6c192-ec96-41ae-b525-614ddd149940 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:09.463204 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7be6c192-ec96-41ae-b525-614ddd149940 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:09.464358 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7be6c192-ec96-41ae-b525-614ddd149940 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:09.493978 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e03f5408-0563-4603-abb9-fad44f6e587b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:09.497944 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:09.504888 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e03f5408-0563-4603-abb9-fad44f6e587b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.189597 Oct 14 13:03:09.505923 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 199/403] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:09 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:09.563487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-18d0928f-d2bf-40c0-a991-691601d01de4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:09.564552 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-18d0928f-d2bf-40c0-a991-691601d01de4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:09.575382 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-18d0928f-d2bf-40c0-a991-691601d01de4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:09.575941 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-18d0928f-d2bf-40c0-a991-691601d01de4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:09.576584 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-18d0928f-d2bf-40c0-a991-691601d01de4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:09.577284 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-18d0928f-d2bf-40c0-a991-691601d01de4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:09.577766 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-18d0928f-d2bf-40c0-a991-691601d01de4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:09.578348 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-18d0928f-d2bf-40c0-a991-691601d01de4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:09.643158 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-7be6c192-ec96-41ae-b525-614ddd149940 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:09.651183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7be6c192-ec96-41ae-b525-614ddd149940 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1653 microversion: 2.1 time: 0.215605 Oct 14 13:03:09.651691 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 205/404] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:09 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1653 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:03:09.674690 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-dd0ded87-0f7c-4ce8-b686-56bdde4ed47c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:09.680942 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dd0ded87-0f7c-4ce8-b686-56bdde4ed47c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:09.681433 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dd0ded87-0f7c-4ce8-b686-56bdde4ed47c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:09.681914 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dd0ded87-0f7c-4ce8-b686-56bdde4ed47c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:09.707174 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-dd0ded87-0f7c-4ce8-b686-56bdde4ed47c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Going to try to start instance {{(pid=118868) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 14 13:03:09.745405 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-18d0928f-d2bf-40c0-a991-691601d01de4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:09.756776 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-dd0ded87-0f7c-4ce8-b686-56bdde4ed47c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "POST /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/action" status: 202 len: 0 microversion: 2.1 time: 0.085672 Oct 14 13:03:09.760471 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 206/405] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Oct 14 13:03:09 2022] POST /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 13:03:09.760620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-18d0928f-d2bf-40c0-a991-691601d01de4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:09.760620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-18d0928f-d2bf-40c0-a991-691601d01de4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:09.766607 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-82ac2697-cfe9-4a9d-9ca3-cc0c0b8b2f8a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:09.767265 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-18d0928f-d2bf-40c0-a991-691601d01de4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1796 microversion: 2.20 time: 0.207507 Oct 14 13:03:09.767416 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-82ac2697-cfe9-4a9d-9ca3-cc0c0b8b2f8a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:09.768459 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 200/406] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:09 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1796 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:03:09.778560 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-82ac2697-cfe9-4a9d-9ca3-cc0c0b8b2f8a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:09.778560 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-82ac2697-cfe9-4a9d-9ca3-cc0c0b8b2f8a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:09.778560 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-82ac2697-cfe9-4a9d-9ca3-cc0c0b8b2f8a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:09.778560 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-82ac2697-cfe9-4a9d-9ca3-cc0c0b8b2f8a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:09.779039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-82ac2697-cfe9-4a9d-9ca3-cc0c0b8b2f8a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:09.779039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-82ac2697-cfe9-4a9d-9ca3-cc0c0b8b2f8a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:09.945961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-82ac2697-cfe9-4a9d-9ca3-cc0c0b8b2f8a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:09.953853 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-82ac2697-cfe9-4a9d-9ca3-cc0c0b8b2f8a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1662 microversion: 2.1 time: 0.191709 Oct 14 13:03:09.954618 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 207/407] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:09 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1662 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:03:10.261585 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d6a71da6-75d4-43a0-b12c-29bdb57ec84c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:10.262245 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-d6a71da6-75d4-43a0-b12c-29bdb57ec84c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:10.268153 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d6a71da6-75d4-43a0-b12c-29bdb57ec84c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:10.268630 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d6a71da6-75d4-43a0-b12c-29bdb57ec84c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:10.269059 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d6a71da6-75d4-43a0-b12c-29bdb57ec84c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:10.269901 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d6a71da6-75d4-43a0-b12c-29bdb57ec84c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:10.270413 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d6a71da6-75d4-43a0-b12c-29bdb57ec84c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:10.270833 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d6a71da6-75d4-43a0-b12c-29bdb57ec84c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:10.285029 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-d6a71da6-75d4-43a0-b12c-29bdb57ec84c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] HTTP exception thrown: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d6a71da6-75d4-43a0-b12c-29bdb57ec84c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Request method failure captured: Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 HTTP/1.1 Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1FViMK-WvBvO8SLI8drD1UcXlTPANFWG-ZTvaw7ModKJdGRWngdLI5cp6n7bXZ7oPe4LkLOonqm901dlPL1Z_CDQlnflfzMT4YPNiiBNZ_K890mBj2sVo-ptm5duO44Ujpzx_OuaK4ZxTnFio58yttRWo_3AshSXsX0p_7cyovml4 Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:03:10.287319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:03:10.288722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c0d083e8cef4333b9514d2256991647", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:03:10.288722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:03:10.288722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:03:10.288722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:03:10.288722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:03:10.288722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:03:10.288722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:03:10.288722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 0bcbf6513b6a4df3b044fadfb7888d54 Oct 14 13:03:10.288722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:03:10.288722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:03:10.288722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. Oct 14 13:03:10.288722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': 'defcc0c0-d0f4-4913-899d-4d20b75896d6'} Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:03:10.289450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. Oct 14 13:03:10.290660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:03:10.291703 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d6a71da6-75d4-43a0-b12c-29bdb57ec84c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Returning 404 to user: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:03:10.291703 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-d6a71da6-75d4-43a0-b12c-29bdb57ec84c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 404 len: 111 microversion: 2.1 time: 0.031034 Oct 14 13:03:10.291703 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 201/408] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:10 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:03:10.297574 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f8e055c9-77ac-4baa-8b29-d0d63bcb271b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '.version_select at 0x7fbb81bea280>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:10.317596 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f8e055c9-77ac-4baa-8b29-d0d63bcb271b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-246404629" status: 202 len: 0 microversion: 2.1 time: 0.023153 Oct 14 13:03:10.318474 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 208/409] 10.222.0.47 () {58 vars in 1218 bytes} [Fri Oct 14 13:03:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-246404629 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:03:10.528331 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-32125e41-c0b4-46ce-954d-7562301da0fd tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:10.528960 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-32125e41-c0b4-46ce-954d-7562301da0fd tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:10.534914 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-32125e41-c0b4-46ce-954d-7562301da0fd tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:10.535394 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-32125e41-c0b4-46ce-954d-7562301da0fd tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:10.535856 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-32125e41-c0b4-46ce-954d-7562301da0fd tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:10.536529 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-32125e41-c0b4-46ce-954d-7562301da0fd tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:10.536970 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-32125e41-c0b4-46ce-954d-7562301da0fd tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:10.537383 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-32125e41-c0b4-46ce-954d-7562301da0fd tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:10.741822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-32125e41-c0b4-46ce-954d-7562301da0fd tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:10.749952 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-32125e41-c0b4-46ce-954d-7562301da0fd tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.225632 Oct 14 13:03:10.750516 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 202/410] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:10 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:10.976906 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1202742b-3a53-4e6e-adda-40be1bac086a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:10.977714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1202742b-3a53-4e6e-adda-40be1bac086a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:10.984335 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1202742b-3a53-4e6e-adda-40be1bac086a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:10.986640 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1202742b-3a53-4e6e-adda-40be1bac086a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:10.987377 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1202742b-3a53-4e6e-adda-40be1bac086a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:10.988006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1202742b-3a53-4e6e-adda-40be1bac086a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:10.988523 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1202742b-3a53-4e6e-adda-40be1bac086a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:10.989785 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1202742b-3a53-4e6e-adda-40be1bac086a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:11.008561 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0ff421e2-ff1e-42e1-bc9a-b25326fec685 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Action: 'create', calling method: .version_select at 0x7fbb81ae6d30>, body: {"keypair": {"name": "tempest-keypair-785556372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFDFwgTJrurzL/5OQ/fm+f/hDoKdtumcnf1pSv0G/L0/mLOUBN3bScvDFfnF14bd0yU0PAwcEJNTg59reZ0WMiem4JxAh3PB8JdwisA24FrhxNn1xs1bMLgXjSNvJZ28Q=="}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:11.023646 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-0ff421e2-ff1e-42e1-bc9a-b25326fec685 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for project 6c0d083e8cef4333b9514d2256991647. Resources: {'key_pairs'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:03:11.027565 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-0ff421e2-ff1e-42e1-bc9a-b25326fec685 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for user 0bcbf6513b6a4df3b044fadfb7888d54 and project 6c0d083e8cef4333b9514d2256991647. Resources: {'key_pairs'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:03:11.049852 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-0ff421e2-ff1e-42e1-bc9a-b25326fec685 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045016 Oct 14 13:03:11.050443 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 203/411] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Oct 14 13:03:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:03:11.126808 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-1202742b-3a53-4e6e-adda-40be1bac086a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:11.134801 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1202742b-3a53-4e6e-adda-40be1bac086a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1662 microversion: 2.1 time: 0.162345 Oct 14 13:03:11.135443 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 209/412] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:10 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1662 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:11.775026 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-26391c2d-3d26-4144-a146-ee1af761b25c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:11.775793 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-26391c2d-3d26-4144-a146-ee1af761b25c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:11.782406 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-26391c2d-3d26-4144-a146-ee1af761b25c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:11.782969 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-26391c2d-3d26-4144-a146-ee1af761b25c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:11.783477 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-26391c2d-3d26-4144-a146-ee1af761b25c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:11.784253 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-26391c2d-3d26-4144-a146-ee1af761b25c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:11.784707 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-26391c2d-3d26-4144-a146-ee1af761b25c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:11.785133 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-26391c2d-3d26-4144-a146-ee1af761b25c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:12.016403 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-26391c2d-3d26-4144-a146-ee1af761b25c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:12.024677 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-26391c2d-3d26-4144-a146-ee1af761b25c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.254490 Oct 14 13:03:12.025241 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 204/413] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:11 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:12.158494 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1f41a3a5-a198-4e5c-8e05-fb762d1ea547 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:12.159034 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1f41a3a5-a198-4e5c-8e05-fb762d1ea547 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:12.165630 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f41a3a5-a198-4e5c-8e05-fb762d1ea547 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:12.166115 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f41a3a5-a198-4e5c-8e05-fb762d1ea547 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:12.166548 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f41a3a5-a198-4e5c-8e05-fb762d1ea547 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:12.167231 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f41a3a5-a198-4e5c-8e05-fb762d1ea547 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:12.167681 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f41a3a5-a198-4e5c-8e05-fb762d1ea547 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:12.168123 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f41a3a5-a198-4e5c-8e05-fb762d1ea547 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:12.299346 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-1f41a3a5-a198-4e5c-8e05-fb762d1ea547 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:12.308120 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1f41a3a5-a198-4e5c-8e05-fb762d1ea547 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1666 microversion: 2.1 time: 0.153631 Oct 14 13:03:12.308690 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 210/414] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:12 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1666 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:03:12.402007 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-343556564", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "70bca7d9-a052-4048-8e74-16b14b95c03e"}], "security_groups": [{"name": "tempest-securitygroup--1427230155"}], "key_name": "tempest-keypair-785556372", "user_data": "}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:12.503607 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.network.neutron [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] validate_networks() for [('70bca7d9-a052-4048-8e74-16b14b95c03e', None, None, None, None, None)] {{(pid=118869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:03:12.863657 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Flavor limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:03:12.864261 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Image limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:03:12.864522 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Flavor pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:03:12.864923 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Image pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:03:12.865323 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:03:12.873956 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:12.874425 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:12.874852 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:12.875561 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:12.876005 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:12.876420 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:12.892797 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for project 6c0d083e8cef4333b9514d2256991647. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:03:12.897386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for user 0bcbf6513b6a4df3b044fadfb7888d54 and project 6c0d083e8cef4333b9514d2256991647. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:03:12.908434 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Going to run 1 instances... {{(pid=118869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:03:12.911283 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:03:12.958766 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4f14421a-b470-4782-8b7c-706e7e73fc77 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.560937 Oct 14 13:03:12.959481 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 205/415] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:03:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 13:03:12.970538 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b5d46c66-f3f6-4301-8db6-c928507307dc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:12.971180 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b5d46c66-f3f6-4301-8db6-c928507307dc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:13.025152 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b5d46c66-f3f6-4301-8db6-c928507307dc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:13.032116 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b5d46c66-f3f6-4301-8db6-c928507307dc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1240 microversion: 2.1 time: 0.065513 Oct 14 13:03:13.037336 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 211/416] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:12 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:13.049238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-831b71ef-eea0-440f-bf4c-36e9faa6374d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:13.049880 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-831b71ef-eea0-440f-bf4c-36e9faa6374d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:13.051804 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:13.059910 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-831b71ef-eea0-440f-bf4c-36e9faa6374d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:13.060482 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-831b71ef-eea0-440f-bf4c-36e9faa6374d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:13.061014 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-831b71ef-eea0-440f-bf4c-36e9faa6374d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:13.061737 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-831b71ef-eea0-440f-bf4c-36e9faa6374d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:13.062187 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-831b71ef-eea0-440f-bf4c-36e9faa6374d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:13.062655 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-831b71ef-eea0-440f-bf4c-36e9faa6374d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:13.200012 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-831b71ef-eea0-440f-bf4c-36e9faa6374d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:13.210004 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-831b71ef-eea0-440f-bf4c-36e9faa6374d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.164580 Oct 14 13:03:13.210522 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 206/417] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:13 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:03:14.055668 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7003b4e4-19fa-4ab5-8ff7-f8336a214b09 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:14.056224 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-7003b4e4-19fa-4ab5-8ff7-f8336a214b09 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:14.062766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7003b4e4-19fa-4ab5-8ff7-f8336a214b09 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:14.063252 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7003b4e4-19fa-4ab5-8ff7-f8336a214b09 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:14.063692 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7003b4e4-19fa-4ab5-8ff7-f8336a214b09 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:14.064380 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7003b4e4-19fa-4ab5-8ff7-f8336a214b09 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:14.064838 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7003b4e4-19fa-4ab5-8ff7-f8336a214b09 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:14.065265 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7003b4e4-19fa-4ab5-8ff7-f8336a214b09 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:14.132790 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-7003b4e4-19fa-4ab5-8ff7-f8336a214b09 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:14.140553 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7003b4e4-19fa-4ab5-8ff7-f8336a214b09 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1292 microversion: 2.1 time: 0.089401 Oct 14 13:03:14.141413 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 212/418] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:14 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:14.233573 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7674201e-d19c-41e9-b9fd-5d719526a58f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:14.234177 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7674201e-d19c-41e9-b9fd-5d719526a58f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:14.241209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7674201e-d19c-41e9-b9fd-5d719526a58f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:14.241734 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7674201e-d19c-41e9-b9fd-5d719526a58f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:14.242164 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7674201e-d19c-41e9-b9fd-5d719526a58f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:14.242848 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7674201e-d19c-41e9-b9fd-5d719526a58f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:14.243291 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7674201e-d19c-41e9-b9fd-5d719526a58f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:14.243702 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7674201e-d19c-41e9-b9fd-5d719526a58f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:14.445438 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7674201e-d19c-41e9-b9fd-5d719526a58f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:14.453696 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7674201e-d19c-41e9-b9fd-5d719526a58f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.224084 Oct 14 13:03:14.454254 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 207/419] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:14 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:03:15.165258 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9e9da537-a1cb-444b-a403-11993c9cfd18 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:15.166427 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-9e9da537-a1cb-444b-a403-11993c9cfd18 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:15.173432 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e9da537-a1cb-444b-a403-11993c9cfd18 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:15.173918 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e9da537-a1cb-444b-a403-11993c9cfd18 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:15.174346 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e9da537-a1cb-444b-a403-11993c9cfd18 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:15.175037 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e9da537-a1cb-444b-a403-11993c9cfd18 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:15.175553 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e9da537-a1cb-444b-a403-11993c9cfd18 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:15.176536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e9da537-a1cb-444b-a403-11993c9cfd18 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:15.308236 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9e9da537-a1cb-444b-a403-11993c9cfd18 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:15.315762 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-9e9da537-a1cb-444b-a403-11993c9cfd18 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1366 microversion: 2.1 time: 0.156226 Oct 14 13:03:15.325902 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 213/420] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:15 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:15.476718 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d0bdcca9-108c-4a58-a15e-2550e8acc3ea tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:15.477323 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-d0bdcca9-108c-4a58-a15e-2550e8acc3ea tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:15.490774 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d0bdcca9-108c-4a58-a15e-2550e8acc3ea tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:15.491504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d0bdcca9-108c-4a58-a15e-2550e8acc3ea tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:15.491974 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d0bdcca9-108c-4a58-a15e-2550e8acc3ea tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:15.492634 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d0bdcca9-108c-4a58-a15e-2550e8acc3ea tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:15.493091 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d0bdcca9-108c-4a58-a15e-2550e8acc3ea tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:15.493535 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d0bdcca9-108c-4a58-a15e-2550e8acc3ea tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:15.688349 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-d0bdcca9-108c-4a58-a15e-2550e8acc3ea tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:15.696838 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-d0bdcca9-108c-4a58-a15e-2550e8acc3ea tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.224498 Oct 14 13:03:15.697406 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 208/421] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:15 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:03:15.718149 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-927cec82-261e-404d-91f2-07ca46ced331 req-eaa96187-f51a-495e-83bc-c6e140f1b14f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "083c9d37-dbbe-48e2-9fdf-c23648f93a76", "tag": "a2f37eab-d8a1-4f80-9b48-0dc66a773d6f"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:15.728524 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-927cec82-261e-404d-91f2-07ca46ced331 req-eaa96187-f51a-495e-83bc-c6e140f1b14f service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:15.729108 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-927cec82-261e-404d-91f2-07ca46ced331 req-eaa96187-f51a-495e-83bc-c6e140f1b14f service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:15.729662 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-927cec82-261e-404d-91f2-07ca46ced331 req-eaa96187-f51a-495e-83bc-c6e140f1b14f service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:15.741325 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-927cec82-261e-404d-91f2-07ca46ced331 req-eaa96187-f51a-495e-83bc-c6e140f1b14f service nova] Creating event network-changed:a2f37eab-d8a1-4f80-9b48-0dc66a773d6f for instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 on hv-cinder-82099 Oct 14 13:03:15.746223 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-927cec82-261e-404d-91f2-07ca46ced331 req-eaa96187-f51a-495e-83bc-c6e140f1b14f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035104 Oct 14 13:03:15.746871 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 214/422] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:03:16.339815 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-be78d94a-554d-40cb-ab4c-3635ffc0c07e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:16.340430 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-be78d94a-554d-40cb-ab4c-3635ffc0c07e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:16.346452 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-be78d94a-554d-40cb-ab4c-3635ffc0c07e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:16.346936 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-be78d94a-554d-40cb-ab4c-3635ffc0c07e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:16.347374 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-be78d94a-554d-40cb-ab4c-3635ffc0c07e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:16.348069 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-be78d94a-554d-40cb-ab4c-3635ffc0c07e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:16.348521 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-be78d94a-554d-40cb-ab4c-3635ffc0c07e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:16.348947 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-be78d94a-554d-40cb-ab4c-3635ffc0c07e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:16.479571 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-be78d94a-554d-40cb-ab4c-3635ffc0c07e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:16.487466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-be78d94a-554d-40cb-ab4c-3635ffc0c07e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1366 microversion: 2.1 time: 0.151688 Oct 14 13:03:16.488020 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 209/423] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:16 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:16.724692 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-aeae1912-1a77-406d-8b76-60a2b03f7e72 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:16.725414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-aeae1912-1a77-406d-8b76-60a2b03f7e72 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:16.731515 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aeae1912-1a77-406d-8b76-60a2b03f7e72 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:16.731995 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aeae1912-1a77-406d-8b76-60a2b03f7e72 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:16.732423 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aeae1912-1a77-406d-8b76-60a2b03f7e72 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:16.733102 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aeae1912-1a77-406d-8b76-60a2b03f7e72 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:16.733673 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aeae1912-1a77-406d-8b76-60a2b03f7e72 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:16.734094 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-aeae1912-1a77-406d-8b76-60a2b03f7e72 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:16.863274 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-aeae1912-1a77-406d-8b76-60a2b03f7e72 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:16.872102 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-aeae1912-1a77-406d-8b76-60a2b03f7e72 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.152133 Oct 14 13:03:16.872673 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 215/424] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:16 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:17.510596 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-243ab40c-ef89-4018-9678-e27aa309e725 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:17.511239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-243ab40c-ef89-4018-9678-e27aa309e725 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:17.517238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-243ab40c-ef89-4018-9678-e27aa309e725 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:17.517750 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-243ab40c-ef89-4018-9678-e27aa309e725 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:17.518179 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-243ab40c-ef89-4018-9678-e27aa309e725 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:17.518866 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-243ab40c-ef89-4018-9678-e27aa309e725 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:17.519317 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-243ab40c-ef89-4018-9678-e27aa309e725 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:17.520241 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-243ab40c-ef89-4018-9678-e27aa309e725 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:17.754771 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-243ab40c-ef89-4018-9678-e27aa309e725 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:17.763509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-243ab40c-ef89-4018-9678-e27aa309e725 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1366 microversion: 2.1 time: 0.256806 Oct 14 13:03:17.764266 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 210/425] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:17 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:17.895750 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6adca757-457c-45f3-a89c-5905c53c5f34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:17.896305 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-6adca757-457c-45f3-a89c-5905c53c5f34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:17.898736 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:17.904957 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6adca757-457c-45f3-a89c-5905c53c5f34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:17.905448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6adca757-457c-45f3-a89c-5905c53c5f34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:17.905930 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6adca757-457c-45f3-a89c-5905c53c5f34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:17.906631 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6adca757-457c-45f3-a89c-5905c53c5f34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:17.907093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6adca757-457c-45f3-a89c-5905c53c5f34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:17.907526 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6adca757-457c-45f3-a89c-5905c53c5f34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:18.038353 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-6adca757-457c-45f3-a89c-5905c53c5f34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:18.046644 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-6adca757-457c-45f3-a89c-5905c53c5f34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.155520 Oct 14 13:03:18.047207 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 216/426] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:17 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:18.787810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8c76f0c0-d86b-4ff1-b6bd-4305a159cb08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:18.788421 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8c76f0c0-d86b-4ff1-b6bd-4305a159cb08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:18.794361 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8c76f0c0-d86b-4ff1-b6bd-4305a159cb08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:18.794842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8c76f0c0-d86b-4ff1-b6bd-4305a159cb08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:18.795271 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8c76f0c0-d86b-4ff1-b6bd-4305a159cb08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:18.795952 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8c76f0c0-d86b-4ff1-b6bd-4305a159cb08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:18.796399 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8c76f0c0-d86b-4ff1-b6bd-4305a159cb08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:18.796819 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8c76f0c0-d86b-4ff1-b6bd-4305a159cb08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:18.930482 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8c76f0c0-d86b-4ff1-b6bd-4305a159cb08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:18.938111 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8c76f0c0-d86b-4ff1-b6bd-4305a159cb08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1366 microversion: 2.1 time: 0.154698 Oct 14 13:03:18.938675 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 211/427] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:18 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:19.070139 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-efde7eaa-8e3c-472d-85ff-a719c5ebd1c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:19.070826 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-efde7eaa-8e3c-472d-85ff-a719c5ebd1c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:19.077355 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-efde7eaa-8e3c-472d-85ff-a719c5ebd1c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:19.077891 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-efde7eaa-8e3c-472d-85ff-a719c5ebd1c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:19.078332 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-efde7eaa-8e3c-472d-85ff-a719c5ebd1c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:19.079057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-efde7eaa-8e3c-472d-85ff-a719c5ebd1c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:19.079514 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-efde7eaa-8e3c-472d-85ff-a719c5ebd1c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:19.079945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-efde7eaa-8e3c-472d-85ff-a719c5ebd1c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:19.098599 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:19.212061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-efde7eaa-8e3c-472d-85ff-a719c5ebd1c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:19.220322 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-efde7eaa-8e3c-472d-85ff-a719c5ebd1c8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.154168 Oct 14 13:03:19.220881 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 217/428] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:19 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:19.959727 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f49365e2-3936-49b1-9804-963fb8e49d4e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:19.960328 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f49365e2-3936-49b1-9804-963fb8e49d4e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:19.966761 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f49365e2-3936-49b1-9804-963fb8e49d4e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:19.967304 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f49365e2-3936-49b1-9804-963fb8e49d4e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:19.967733 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f49365e2-3936-49b1-9804-963fb8e49d4e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:19.968423 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f49365e2-3936-49b1-9804-963fb8e49d4e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:19.968849 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f49365e2-3936-49b1-9804-963fb8e49d4e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:19.969270 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f49365e2-3936-49b1-9804-963fb8e49d4e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:20.099595 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f49365e2-3936-49b1-9804-963fb8e49d4e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:20.107166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-f49365e2-3936-49b1-9804-963fb8e49d4e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1366 microversion: 2.1 time: 0.151307 Oct 14 13:03:20.107722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 212/429] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:19 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:20.244203 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-feeb173b-f67a-4f6d-871c-fbd3dae3b472 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:20.244809 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-feeb173b-f67a-4f6d-871c-fbd3dae3b472 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:20.251424 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-feeb173b-f67a-4f6d-871c-fbd3dae3b472 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:20.251911 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-feeb173b-f67a-4f6d-871c-fbd3dae3b472 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:20.252345 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-feeb173b-f67a-4f6d-871c-fbd3dae3b472 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:20.253033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-feeb173b-f67a-4f6d-871c-fbd3dae3b472 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:20.253566 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-feeb173b-f67a-4f6d-871c-fbd3dae3b472 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:20.253938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-feeb173b-f67a-4f6d-871c-fbd3dae3b472 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:20.385830 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-feeb173b-f67a-4f6d-871c-fbd3dae3b472 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:20.393927 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-feeb173b-f67a-4f6d-871c-fbd3dae3b472 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1733 microversion: 2.1 time: 0.153664 Oct 14 13:03:20.394973 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 218/430] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:20 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:21.126584 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-10ee984a-3ee5-41b3-80a7-00799387e57c req-f482343c-cb86-4fa4-9f41-afa5773dc156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083c9d37-dbbe-48e2-9fdf-c23648f93a76", "name": "network-vif-plugged", "status": "completed", "tag": "a2f37eab-d8a1-4f80-9b48-0dc66a773d6f"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:21.130139 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1aa54316-fea7-4182-a0c1-8f76230ff6f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:21.130871 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1aa54316-fea7-4182-a0c1-8f76230ff6f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:21.136712 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-10ee984a-3ee5-41b3-80a7-00799387e57c req-f482343c-cb86-4fa4-9f41-afa5773dc156 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:21.137190 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-10ee984a-3ee5-41b3-80a7-00799387e57c req-f482343c-cb86-4fa4-9f41-afa5773dc156 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:21.137975 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-10ee984a-3ee5-41b3-80a7-00799387e57c req-f482343c-cb86-4fa4-9f41-afa5773dc156 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:21.138118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1aa54316-fea7-4182-a0c1-8f76230ff6f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:21.138403 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1aa54316-fea7-4182-a0c1-8f76230ff6f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:21.138940 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1aa54316-fea7-4182-a0c1-8f76230ff6f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:21.140140 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1aa54316-fea7-4182-a0c1-8f76230ff6f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:21.142176 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1aa54316-fea7-4182-a0c1-8f76230ff6f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:21.142609 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1aa54316-fea7-4182-a0c1-8f76230ff6f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:21.149164 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-10ee984a-3ee5-41b3-80a7-00799387e57c req-f482343c-cb86-4fa4-9f41-afa5773dc156 service nova] Creating event network-vif-plugged:a2f37eab-d8a1-4f80-9b48-0dc66a773d6f for instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 on hv-cinder-82099 Oct 14 13:03:21.154047 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-10ee984a-3ee5-41b3-80a7-00799387e57c req-f482343c-cb86-4fa4-9f41-afa5773dc156 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031341 Oct 14 13:03:21.154832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 213/431] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:03:21.282554 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-1aa54316-fea7-4182-a0c1-8f76230ff6f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:21.290670 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1aa54316-fea7-4182-a0c1-8f76230ff6f2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1366 microversion: 2.1 time: 0.164968 Oct 14 13:03:21.291244 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 219/432] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:21 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:21.418110 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-10ce1a47-8bbf-4ab1-9624-006062a884f5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:21.418805 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-10ce1a47-8bbf-4ab1-9624-006062a884f5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:21.424885 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-10ce1a47-8bbf-4ab1-9624-006062a884f5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:21.425364 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-10ce1a47-8bbf-4ab1-9624-006062a884f5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:21.426398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-10ce1a47-8bbf-4ab1-9624-006062a884f5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:21.427081 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-10ce1a47-8bbf-4ab1-9624-006062a884f5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:21.427530 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-10ce1a47-8bbf-4ab1-9624-006062a884f5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:21.427950 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-10ce1a47-8bbf-4ab1-9624-006062a884f5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:21.554252 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-10ce1a47-8bbf-4ab1-9624-006062a884f5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:21.562355 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-10ce1a47-8bbf-4ab1-9624-006062a884f5 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1713 microversion: 2.1 time: 0.148587 Oct 14 13:03:21.562916 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 214/433] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:21 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1713 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:21.669932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d0b69ff9-2afb-4eb1-9e80-529e968a96e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:21.670420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-d0b69ff9-2afb-4eb1-9e80-529e968a96e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:21.676900 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0b69ff9-2afb-4eb1-9e80-529e968a96e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:21.677367 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0b69ff9-2afb-4eb1-9e80-529e968a96e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:21.677814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0b69ff9-2afb-4eb1-9e80-529e968a96e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:21.678492 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0b69ff9-2afb-4eb1-9e80-529e968a96e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:21.678938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0b69ff9-2afb-4eb1-9e80-529e968a96e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:21.679357 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0b69ff9-2afb-4eb1-9e80-529e968a96e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:21.761403 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-d0b69ff9-2afb-4eb1-9e80-529e968a96e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] HTTP exception thrown: Cannot 'detach_volume' instance ac1bf768-41b1-41c6-9621-d0aaead003e5 while it is in vm_state rescued Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d0b69ff9-2afb-4eb1-9e80-529e968a96e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Request method failure captured: Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: DELETE /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/os-volume_attachments/c432df6d-01c3-42cf-8865-66387bcf439f HTTP/1.1 Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV1Cs09Cu8vSps46z6W6PeSQaPlaz7RbycBpbAaKGyNLkJbBPIE899Agnc8xKbSQMAp8rE7tSu7AwxUpIowQS4vJkiL31SuEvGTrM_qnAchngAi6kRbyLURlB3MBaW58J1FeYinNbeUIsTaDmwhcpSEQThHsj_MktdqLjb4gv2tw8pQ Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: c160176d8c804b7793bae21c205c538c Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-284328419 Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:03:21.763005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:03:21.764602 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c160176d8c804b7793bae21c205c538c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c160176d8c804b7793bae21c205c538c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c160176d8c804b7793bae21c205c538c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c160176d8c804b7793bae21c205c538c", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:03:21.764602 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-ServerRescueNegativeTestJSON-284328419 Oct 14 13:03:21.764602 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: c160176d8c804b7793bae21c205c538c Oct 14 13:03:21.764602 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-284328419 Oct 14 13:03:21.764602 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-ServerRescueNegativeTestJSON-284328419-project Oct 14 13:03:21.764602 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:03:21.764602 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:03:21.764602 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 60860294eb284b8aa11edd42dca4ae8d Oct 14 13:03:21.764602 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-ServerRescueNegativeTestJSON-284328419-project Oct 14 13:03:21.764602 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:03:21.764602 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Cannot 'detach_volume' instance ac1bf768-41b1-41c6-9621-d0aaead003e5 while it is in vm_state rescued Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'server_id': 'ac1bf768-41b1-41c6-9621-d0aaead003e5', 'id': 'c432df6d-01c3-42cf-8865-66387bcf439f'} Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ac1bf768-41b1-41c6-9621-d0aaead003e5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:03:21.765342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ac1bf768-41b1-41c6-9621-d0aaead003e5 while it is in vm_state rescued Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ac1bf768-41b1-41c6-9621-d0aaead003e5 while it is in vm_state rescued Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:03:21.766713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d0b69ff9-2afb-4eb1-9e80-529e968a96e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Returning 409 to user: Cannot 'detach_volume' instance ac1bf768-41b1-41c6-9621-d0aaead003e5 while it is in vm_state rescued {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:03:21.767989 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-d0b69ff9-2afb-4eb1-9e80-529e968a96e8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/os-volume_attachments/c432df6d-01c3-42cf-8865-66387bcf439f" status: 409 len: 152 microversion: 2.1 time: 0.098505 Oct 14 13:03:21.767989 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 220/434] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Oct 14 13:03:21 2022] DELETE /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/os-volume_attachments/c432df6d-01c3-42cf-8865-66387bcf439f => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 14 13:03:21.773855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7430791f-3d14-4116-a244-3714eb9f8fe2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:21.774383 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7430791f-3d14-4116-a244-3714eb9f8fe2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:21.780301 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7430791f-3d14-4116-a244-3714eb9f8fe2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:21.780785 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7430791f-3d14-4116-a244-3714eb9f8fe2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:21.781213 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7430791f-3d14-4116-a244-3714eb9f8fe2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:21.781916 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7430791f-3d14-4116-a244-3714eb9f8fe2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:21.782369 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7430791f-3d14-4116-a244-3714eb9f8fe2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:21.782787 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7430791f-3d14-4116-a244-3714eb9f8fe2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:21.848989 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7430791f-3d14-4116-a244-3714eb9f8fe2 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "POST /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/action" status: 202 len: 0 microversion: 2.1 time: 0.079339 Oct 14 13:03:21.849621 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 215/435] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Oct 14 13:03:21 2022] POST /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:03:21.857839 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7a3ae60a-2f9f-43da-86ff-d7bff83dd9d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:21.858454 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-7a3ae60a-2f9f-43da-86ff-d7bff83dd9d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:21.865888 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7a3ae60a-2f9f-43da-86ff-d7bff83dd9d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:21.866377 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7a3ae60a-2f9f-43da-86ff-d7bff83dd9d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:21.866813 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7a3ae60a-2f9f-43da-86ff-d7bff83dd9d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:21.867502 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7a3ae60a-2f9f-43da-86ff-d7bff83dd9d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:21.867960 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7a3ae60a-2f9f-43da-86ff-d7bff83dd9d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:21.868389 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7a3ae60a-2f9f-43da-86ff-d7bff83dd9d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:21.995420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-7a3ae60a-2f9f-43da-86ff-d7bff83dd9d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:22.003745 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7a3ae60a-2f9f-43da-86ff-d7bff83dd9d1 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1721 microversion: 2.1 time: 0.149697 Oct 14 13:03:22.004877 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 221/436] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:21 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:22.313506 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-484599b1-24c9-4d0f-9291-870f5368aa27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:22.314271 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-484599b1-24c9-4d0f-9291-870f5368aa27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:22.320332 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-484599b1-24c9-4d0f-9291-870f5368aa27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:22.320800 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-484599b1-24c9-4d0f-9291-870f5368aa27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:22.321228 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-484599b1-24c9-4d0f-9291-870f5368aa27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:22.321933 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-484599b1-24c9-4d0f-9291-870f5368aa27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:22.322381 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-484599b1-24c9-4d0f-9291-870f5368aa27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:22.322795 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-484599b1-24c9-4d0f-9291-870f5368aa27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:22.521405 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-484599b1-24c9-4d0f-9291-870f5368aa27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:22.529057 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-484599b1-24c9-4d0f-9291-870f5368aa27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1366 microversion: 2.1 time: 0.219735 Oct 14 13:03:22.529649 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 216/437] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:22 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:23.027499 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-8adda1fc-ca7f-417f-b4d6-10511ab41a28 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:23.028115 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-8adda1fc-ca7f-417f-b4d6-10511ab41a28 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:23.030460 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=2 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:23.036111 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8adda1fc-ca7f-417f-b4d6-10511ab41a28 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:23.036601 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8adda1fc-ca7f-417f-b4d6-10511ab41a28 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:23.037039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8adda1fc-ca7f-417f-b4d6-10511ab41a28 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:23.037754 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8adda1fc-ca7f-417f-b4d6-10511ab41a28 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:23.038213 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8adda1fc-ca7f-417f-b4d6-10511ab41a28 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:23.038641 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8adda1fc-ca7f-417f-b4d6-10511ab41a28 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:23.169202 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-8adda1fc-ca7f-417f-b4d6-10511ab41a28 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:23.177529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-8adda1fc-ca7f-417f-b4d6-10511ab41a28 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1721 microversion: 2.1 time: 0.153902 Oct 14 13:03:23.178096 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 222/438] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:23 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:23.554081 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-62083cc9-1be3-43aa-a28d-5e8f006be52c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:23.554781 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-62083cc9-1be3-43aa-a28d-5e8f006be52c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:23.556757 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:23.557409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=10 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:23.563002 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-62083cc9-1be3-43aa-a28d-5e8f006be52c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:23.563485 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-62083cc9-1be3-43aa-a28d-5e8f006be52c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:23.564103 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-62083cc9-1be3-43aa-a28d-5e8f006be52c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:23.564799 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-62083cc9-1be3-43aa-a28d-5e8f006be52c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:23.565253 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-62083cc9-1be3-43aa-a28d-5e8f006be52c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:23.565702 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-62083cc9-1be3-43aa-a28d-5e8f006be52c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:23.691153 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-62083cc9-1be3-43aa-a28d-5e8f006be52c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:23.698770 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-62083cc9-1be3-43aa-a28d-5e8f006be52c tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1556 microversion: 2.1 time: 0.150417 Oct 14 13:03:23.699331 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 217/439] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:23 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:23.721602 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-869eccb0-9d50-477f-bf8a-01a645f37071 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:23.722103 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-869eccb0-9d50-477f-bf8a-01a645f37071 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:23.728548 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-869eccb0-9d50-477f-bf8a-01a645f37071 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:23.729027 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-869eccb0-9d50-477f-bf8a-01a645f37071 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:23.729459 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-869eccb0-9d50-477f-bf8a-01a645f37071 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:23.730166 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-869eccb0-9d50-477f-bf8a-01a645f37071 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:23.730617 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-869eccb0-9d50-477f-bf8a-01a645f37071 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:23.731039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-869eccb0-9d50-477f-bf8a-01a645f37071 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:23.808382 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-869eccb0-9d50-477f-bf8a-01a645f37071 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090883 Oct 14 13:03:23.808975 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 223/440] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Oct 14 13:03:23 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:03:24.201962 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-814c2b65-1112-4e74-9f4a-48e6d2f7f546 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:24.202704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-814c2b65-1112-4e74-9f4a-48e6d2f7f546 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:24.209250 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-814c2b65-1112-4e74-9f4a-48e6d2f7f546 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:24.209763 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-814c2b65-1112-4e74-9f4a-48e6d2f7f546 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:24.210201 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-814c2b65-1112-4e74-9f4a-48e6d2f7f546 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:24.210886 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-814c2b65-1112-4e74-9f4a-48e6d2f7f546 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:24.211342 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-814c2b65-1112-4e74-9f4a-48e6d2f7f546 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:24.211762 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-814c2b65-1112-4e74-9f4a-48e6d2f7f546 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:24.230965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:24.444425 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-814c2b65-1112-4e74-9f4a-48e6d2f7f546 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:24.452806 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-814c2b65-1112-4e74-9f4a-48e6d2f7f546 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1721 microversion: 2.1 time: 0.255212 Oct 14 13:03:24.454411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 218/441] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:24 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:24.797129 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-4fd84e0c-f0e9-497f-972f-848d0b275b5f req-294625e3-4275-4520-8de4-ba0c01f1748c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "083c9d37-dbbe-48e2-9fdf-c23648f93a76", "tag": "a2f37eab-d8a1-4f80-9b48-0dc66a773d6f"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:24.807253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-4fd84e0c-f0e9-497f-972f-848d0b275b5f req-294625e3-4275-4520-8de4-ba0c01f1748c service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:24.807809 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-4fd84e0c-f0e9-497f-972f-848d0b275b5f req-294625e3-4275-4520-8de4-ba0c01f1748c service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:24.808307 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-4fd84e0c-f0e9-497f-972f-848d0b275b5f req-294625e3-4275-4520-8de4-ba0c01f1748c service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:24.819779 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-4fd84e0c-f0e9-497f-972f-848d0b275b5f req-294625e3-4275-4520-8de4-ba0c01f1748c service nova] Creating event network-changed:a2f37eab-d8a1-4f80-9b48-0dc66a773d6f for instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 on hv-cinder-82099 Oct 14 13:03:24.825852 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-4fd84e0c-f0e9-497f-972f-848d0b275b5f req-294625e3-4275-4520-8de4-ba0c01f1748c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032863 Oct 14 13:03:24.826450 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 224/442] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:03:25.477048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-9499a011-5046-4d79-8928-f30f10cb65b4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:25.478001 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-9499a011-5046-4d79-8928-f30f10cb65b4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:25.484960 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9499a011-5046-4d79-8928-f30f10cb65b4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:25.485539 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9499a011-5046-4d79-8928-f30f10cb65b4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:25.486060 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9499a011-5046-4d79-8928-f30f10cb65b4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:25.486838 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9499a011-5046-4d79-8928-f30f10cb65b4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:25.487360 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9499a011-5046-4d79-8928-f30f10cb65b4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:25.487852 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9499a011-5046-4d79-8928-f30f10cb65b4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:25.649141 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-9499a011-5046-4d79-8928-f30f10cb65b4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:25.658686 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-9499a011-5046-4d79-8928-f30f10cb65b4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1721 microversion: 2.1 time: 0.185960 Oct 14 13:03:25.659262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 219/443] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:25 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:26.687093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-04d26d36-60af-4117-a17d-5801cbe9cebc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:26.687793 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-04d26d36-60af-4117-a17d-5801cbe9cebc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:26.693974 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04d26d36-60af-4117-a17d-5801cbe9cebc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:26.694462 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04d26d36-60af-4117-a17d-5801cbe9cebc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:26.694901 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04d26d36-60af-4117-a17d-5801cbe9cebc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:26.695588 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04d26d36-60af-4117-a17d-5801cbe9cebc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:26.696047 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04d26d36-60af-4117-a17d-5801cbe9cebc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:26.696473 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04d26d36-60af-4117-a17d-5801cbe9cebc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:26.826922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-04d26d36-60af-4117-a17d-5801cbe9cebc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:26.835168 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-04d26d36-60af-4117-a17d-5801cbe9cebc tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1727 microversion: 2.1 time: 0.152865 Oct 14 13:03:26.835737 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 225/444] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:26 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:26.857575 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f393cb44-2841-487f-87fd-368169fbff2c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:26.858069 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f393cb44-2841-487f-87fd-368169fbff2c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:26.864970 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f393cb44-2841-487f-87fd-368169fbff2c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:26.865448 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f393cb44-2841-487f-87fd-368169fbff2c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:26.865913 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f393cb44-2841-487f-87fd-368169fbff2c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:26.866598 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f393cb44-2841-487f-87fd-368169fbff2c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:26.867056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f393cb44-2841-487f-87fd-368169fbff2c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:26.867479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f393cb44-2841-487f-87fd-368169fbff2c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:26.942692 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-f393cb44-2841-487f-87fd-368169fbff2c tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088932 Oct 14 13:03:26.943284 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 220/445] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Oct 14 13:03:26 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:03:27.801321 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-babde41b-4f0b-4f2c-a69a-d812c62fa663 req-0514afaf-6a47-4469-8c52-5964923f49bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1bf768-41b1-41c6-9621-d0aaead003e5", "tag": "7f90ffc6-2d72-4ce5-b0ce-2855a620d1c5"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:27.811919 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-babde41b-4f0b-4f2c-a69a-d812c62fa663 req-0514afaf-6a47-4469-8c52-5964923f49bd service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:27.812495 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-babde41b-4f0b-4f2c-a69a-d812c62fa663 req-0514afaf-6a47-4469-8c52-5964923f49bd service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:27.812991 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-babde41b-4f0b-4f2c-a69a-d812c62fa663 req-0514afaf-6a47-4469-8c52-5964923f49bd service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:27.825141 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-babde41b-4f0b-4f2c-a69a-d812c62fa663 req-0514afaf-6a47-4469-8c52-5964923f49bd service nova] Creating event network-changed:7f90ffc6-2d72-4ce5-b0ce-2855a620d1c5 for instance ac1bf768-41b1-41c6-9621-d0aaead003e5 on hv-cinder-82099 Oct 14 13:03:27.831300 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-babde41b-4f0b-4f2c-a69a-d812c62fa663 req-0514afaf-6a47-4469-8c52-5964923f49bd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034199 Oct 14 13:03:27.831953 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 226/446] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:03:29.845530 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-dac15928-82b7-49c5-b312-91ef8a42c87b req-9d7e32ea-73db-46bd-825a-3ee99092a68f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac1bf768-41b1-41c6-9621-d0aaead003e5", "tag": "7f90ffc6-2d72-4ce5-b0ce-2855a620d1c5"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:29.855477 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-dac15928-82b7-49c5-b312-91ef8a42c87b req-9d7e32ea-73db-46bd-825a-3ee99092a68f service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:29.855946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-dac15928-82b7-49c5-b312-91ef8a42c87b req-9d7e32ea-73db-46bd-825a-3ee99092a68f service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:29.856371 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-dac15928-82b7-49c5-b312-91ef8a42c87b req-9d7e32ea-73db-46bd-825a-3ee99092a68f service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:29.868091 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-dac15928-82b7-49c5-b312-91ef8a42c87b req-9d7e32ea-73db-46bd-825a-3ee99092a68f service nova] Creating event network-changed:7f90ffc6-2d72-4ce5-b0ce-2855a620d1c5 for instance ac1bf768-41b1-41c6-9621-d0aaead003e5 on hv-cinder-82099 Oct 14 13:03:29.873181 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-dac15928-82b7-49c5-b312-91ef8a42c87b req-9d7e32ea-73db-46bd-825a-3ee99092a68f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030980 Oct 14 13:03:29.873783 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 221/447] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:03:48.149118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=21 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:48.149885 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=46 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:48.154678 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ab608799-6275-46df-9092-3d4768dee03e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:48.155261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-ab608799-6275-46df-9092-3d4768dee03e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:48.162496 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab608799-6275-46df-9092-3d4768dee03e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:48.162980 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab608799-6275-46df-9092-3d4768dee03e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:48.163416 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab608799-6275-46df-9092-3d4768dee03e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:48.164102 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab608799-6275-46df-9092-3d4768dee03e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:48.164563 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab608799-6275-46df-9092-3d4768dee03e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:48.164984 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ab608799-6275-46df-9092-3d4768dee03e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:48.194092 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ab608799-6275-46df-9092-3d4768dee03e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/os-volume_attachments/37224fa2-185d-4b5c-8ea0-90e62ebe2a6c" status: 200 len: 194 microversion: 2.20 time: 0.046818 Oct 14 13:03:48.194661 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 227/448] 10.222.0.47 () {60 vars in 1454 bytes} [Fri Oct 14 13:03:48 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/os-volume_attachments/37224fa2-185d-4b5c-8ea0-90e62ebe2a6c => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 13:03:48.266727 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f9ab2a01-103c-420d-bdb5-96b8cdcd2929 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:48.267300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f9ab2a01-103c-420d-bdb5-96b8cdcd2929 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:48.269463 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=31 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:48.270114 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=14 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:03:48.276947 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f9ab2a01-103c-420d-bdb5-96b8cdcd2929 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:48.277424 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f9ab2a01-103c-420d-bdb5-96b8cdcd2929 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:48.277890 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f9ab2a01-103c-420d-bdb5-96b8cdcd2929 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:48.278565 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f9ab2a01-103c-420d-bdb5-96b8cdcd2929 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:48.279010 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f9ab2a01-103c-420d-bdb5-96b8cdcd2929 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:48.279442 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f9ab2a01-103c-420d-bdb5-96b8cdcd2929 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:48.364098 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-f9ab2a01-103c-420d-bdb5-96b8cdcd2929 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lazy-loading 'services' on Instance uuid f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:03:48.433388 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-f9ab2a01-103c-420d-bdb5-96b8cdcd2929 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/os-volume_attachments/37224fa2-185d-4b5c-8ea0-90e62ebe2a6c" status: 202 len: 0 microversion: 2.20 time: 0.170794 Oct 14 13:03:48.434098 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 222/449] 10.222.0.47 () {60 vars in 1457 bytes} [Fri Oct 14 13:03:48 2022] DELETE /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/os-volume_attachments/37224fa2-185d-4b5c-8ea0-90e62ebe2a6c => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:03:48.442366 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-77961b99-080e-478a-98a0-d67d6e0a5ddc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:48.444506 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-77961b99-080e-478a-98a0-d67d6e0a5ddc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:48.450929 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-77961b99-080e-478a-98a0-d67d6e0a5ddc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:48.451416 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-77961b99-080e-478a-98a0-d67d6e0a5ddc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:48.451847 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-77961b99-080e-478a-98a0-d67d6e0a5ddc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:48.452536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-77961b99-080e-478a-98a0-d67d6e0a5ddc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:48.452988 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-77961b99-080e-478a-98a0-d67d6e0a5ddc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:48.453408 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-77961b99-080e-478a-98a0-d67d6e0a5ddc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:48.482940 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-77961b99-080e-478a-98a0-d67d6e0a5ddc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044443 Oct 14 13:03:48.485649 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 228/450] 10.222.0.47 () {60 vars in 1343 bytes} [Fri Oct 14 13:03:48 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 13:03:49.496399 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d4f3e829-dfd6-4f38-a276-595b7372f3f4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:49.498759 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-d4f3e829-dfd6-4f38-a276-595b7372f3f4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:49.504948 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d4f3e829-dfd6-4f38-a276-595b7372f3f4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:49.505425 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d4f3e829-dfd6-4f38-a276-595b7372f3f4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:49.505891 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d4f3e829-dfd6-4f38-a276-595b7372f3f4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:49.506569 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d4f3e829-dfd6-4f38-a276-595b7372f3f4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:49.507016 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d4f3e829-dfd6-4f38-a276-595b7372f3f4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:49.507442 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d4f3e829-dfd6-4f38-a276-595b7372f3f4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:49.536026 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-d4f3e829-dfd6-4f38-a276-595b7372f3f4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044011 Oct 14 13:03:49.536571 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 223/451] 10.222.0.47 () {60 vars in 1343 bytes} [Fri Oct 14 13:03:49 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:49.598284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-07343d6d-0daa-4a17-ac35-b53882961087 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:49.598770 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-07343d6d-0daa-4a17-ac35-b53882961087 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:49.605818 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-07343d6d-0daa-4a17-ac35-b53882961087 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:49.606303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-07343d6d-0daa-4a17-ac35-b53882961087 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:49.606736 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-07343d6d-0daa-4a17-ac35-b53882961087 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:49.607424 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-07343d6d-0daa-4a17-ac35-b53882961087 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:49.607892 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-07343d6d-0daa-4a17-ac35-b53882961087 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:49.608315 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-07343d6d-0daa-4a17-ac35-b53882961087 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:49.634630 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-07343d6d-0daa-4a17-ac35-b53882961087 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Going to try to terminate instance {{(pid=118868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:03:49.709398 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-07343d6d-0daa-4a17-ac35-b53882961087 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 204 len: 0 microversion: 2.20 time: 0.114684 Oct 14 13:03:49.710025 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 229/452] 10.222.0.47 () {60 vars in 1280 bytes} [Fri Oct 14 13:03:49 2022] DELETE /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 14 13:03:49.720463 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c106f790-fb52-47a5-934f-a7a382621efe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:49.721070 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c106f790-fb52-47a5-934f-a7a382621efe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:49.726993 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c106f790-fb52-47a5-934f-a7a382621efe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:49.727470 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c106f790-fb52-47a5-934f-a7a382621efe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:49.727903 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c106f790-fb52-47a5-934f-a7a382621efe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:49.728587 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c106f790-fb52-47a5-934f-a7a382621efe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:49.729036 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c106f790-fb52-47a5-934f-a7a382621efe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:49.729458 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c106f790-fb52-47a5-934f-a7a382621efe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:49.862968 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c106f790-fb52-47a5-934f-a7a382621efe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:49.871939 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c106f790-fb52-47a5-934f-a7a382621efe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:49.873367 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c106f790-fb52-47a5-934f-a7a382621efe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:49.874545 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c106f790-fb52-47a5-934f-a7a382621efe tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.158618 Oct 14 13:03:49.875095 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 224/453] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:49 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:03:50.901109 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-beb95421-9d28-4137-b8e5-ed86113014af tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:50.901828 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-beb95421-9d28-4137-b8e5-ed86113014af tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:50.908115 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-beb95421-9d28-4137-b8e5-ed86113014af tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:50.908601 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-beb95421-9d28-4137-b8e5-ed86113014af tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:50.909029 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-beb95421-9d28-4137-b8e5-ed86113014af tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:50.909770 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-beb95421-9d28-4137-b8e5-ed86113014af tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:50.910220 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-beb95421-9d28-4137-b8e5-ed86113014af tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:50.910643 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-beb95421-9d28-4137-b8e5-ed86113014af tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:51.038287 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-beb95421-9d28-4137-b8e5-ed86113014af tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:51.047138 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-beb95421-9d28-4137-b8e5-ed86113014af tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:51.048591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-beb95421-9d28-4137-b8e5-ed86113014af tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:51.049793 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-beb95421-9d28-4137-b8e5-ed86113014af tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.153456 Oct 14 13:03:51.050351 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 230/454] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:50 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:03:51.330966 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2282a2aa-82e1-4211-818d-536dd0a8aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:51.333178 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-2282a2aa-82e1-4211-818d-536dd0a8aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:51.339629 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2282a2aa-82e1-4211-818d-536dd0a8aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:51.340101 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2282a2aa-82e1-4211-818d-536dd0a8aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:51.340531 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2282a2aa-82e1-4211-818d-536dd0a8aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:51.341208 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2282a2aa-82e1-4211-818d-536dd0a8aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:51.341690 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2282a2aa-82e1-4211-818d-536dd0a8aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:51.342113 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2282a2aa-82e1-4211-818d-536dd0a8aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:51.370821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-2282a2aa-82e1-4211-818d-536dd0a8aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043800 Oct 14 13:03:51.371359 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 225/455] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:03:51 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 13:03:51.435036 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-060f34ee-76ef-4b5c-a898-76e285d74194 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:51.435526 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-060f34ee-76ef-4b5c-a898-76e285d74194 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:51.441410 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-060f34ee-76ef-4b5c-a898-76e285d74194 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:51.441923 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-060f34ee-76ef-4b5c-a898-76e285d74194 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:51.442355 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-060f34ee-76ef-4b5c-a898-76e285d74194 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:51.443045 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-060f34ee-76ef-4b5c-a898-76e285d74194 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:51.443487 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-060f34ee-76ef-4b5c-a898-76e285d74194 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:51.443918 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-060f34ee-76ef-4b5c-a898-76e285d74194 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:51.468880 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-060f34ee-76ef-4b5c-a898-76e285d74194 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Going to try to terminate instance {{(pid=118868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:03:51.541151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-060f34ee-76ef-4b5c-a898-76e285d74194 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "DELETE /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 204 len: 0 microversion: 2.1 time: 0.109604 Oct 14 13:03:51.542000 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 231/456] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:03:51 2022] DELETE /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:03:51.550038 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5cffb1c4-d1cf-4e67-bc87-cefbc330aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:51.550605 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5cffb1c4-d1cf-4e67-bc87-cefbc330aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:51.557372 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5cffb1c4-d1cf-4e67-bc87-cefbc330aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:51.557889 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5cffb1c4-d1cf-4e67-bc87-cefbc330aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:51.558329 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5cffb1c4-d1cf-4e67-bc87-cefbc330aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:51.559022 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5cffb1c4-d1cf-4e67-bc87-cefbc330aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:51.559472 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5cffb1c4-d1cf-4e67-bc87-cefbc330aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:51.559892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5cffb1c4-d1cf-4e67-bc87-cefbc330aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:51.689331 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-5cffb1c4-d1cf-4e67-bc87-cefbc330aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:51.697054 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5cffb1c4-d1cf-4e67-bc87-cefbc330aa39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1672 microversion: 2.1 time: 0.151014 Oct 14 13:03:51.698297 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 226/457] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:51 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:52.075803 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b5f229ec-cb1a-4bcd-8221-b532c775de27 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:52.076325 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b5f229ec-cb1a-4bcd-8221-b532c775de27 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:52.082955 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b5f229ec-cb1a-4bcd-8221-b532c775de27 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:52.083442 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b5f229ec-cb1a-4bcd-8221-b532c775de27 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:52.083881 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b5f229ec-cb1a-4bcd-8221-b532c775de27 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:52.084567 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b5f229ec-cb1a-4bcd-8221-b532c775de27 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:52.085021 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b5f229ec-cb1a-4bcd-8221-b532c775de27 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:52.085443 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b5f229ec-cb1a-4bcd-8221-b532c775de27 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:52.212057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b5f229ec-cb1a-4bcd-8221-b532c775de27 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:52.220345 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b5f229ec-cb1a-4bcd-8221-b532c775de27 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:52.221869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b5f229ec-cb1a-4bcd-8221-b532c775de27 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:52.223099 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b5f229ec-cb1a-4bcd-8221-b532c775de27 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.151857 Oct 14 13:03:52.223687 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 232/458] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:52 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:03:52.720939 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e2a59167-348e-4093-8901-ad2f3e984d17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:52.721563 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e2a59167-348e-4093-8901-ad2f3e984d17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:52.727429 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e2a59167-348e-4093-8901-ad2f3e984d17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:52.727904 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e2a59167-348e-4093-8901-ad2f3e984d17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:52.728333 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e2a59167-348e-4093-8901-ad2f3e984d17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:52.729011 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e2a59167-348e-4093-8901-ad2f3e984d17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:52.729451 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e2a59167-348e-4093-8901-ad2f3e984d17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:52.729902 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e2a59167-348e-4093-8901-ad2f3e984d17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:52.856297 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e2a59167-348e-4093-8901-ad2f3e984d17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:52.864211 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e2a59167-348e-4093-8901-ad2f3e984d17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1672 microversion: 2.1 time: 0.147572 Oct 14 13:03:52.864759 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 227/459] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:52 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1672 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:53.248804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-bab4b981-f2a8-4357-aae3-c0370197e56b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:53.249350 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-bab4b981-f2a8-4357-aae3-c0370197e56b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:53.255759 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bab4b981-f2a8-4357-aae3-c0370197e56b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:53.256202 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bab4b981-f2a8-4357-aae3-c0370197e56b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:53.256639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bab4b981-f2a8-4357-aae3-c0370197e56b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:53.257351 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bab4b981-f2a8-4357-aae3-c0370197e56b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:53.257831 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bab4b981-f2a8-4357-aae3-c0370197e56b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:53.258258 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bab4b981-f2a8-4357-aae3-c0370197e56b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:53.389009 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-bab4b981-f2a8-4357-aae3-c0370197e56b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:53.397107 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-bab4b981-f2a8-4357-aae3-c0370197e56b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:53.398577 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-bab4b981-f2a8-4357-aae3-c0370197e56b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:53.399724 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-bab4b981-f2a8-4357-aae3-c0370197e56b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1724 microversion: 2.20 time: 0.155407 Oct 14 13:03:53.400264 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 233/460] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:53 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:03:53.889206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e5c382e5-993d-4326-b100-c92a3a7be2f8 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:53.890019 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e5c382e5-993d-4326-b100-c92a3a7be2f8 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:53.896314 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e5c382e5-993d-4326-b100-c92a3a7be2f8 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:53.896917 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e5c382e5-993d-4326-b100-c92a3a7be2f8 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:53.897449 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e5c382e5-993d-4326-b100-c92a3a7be2f8 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:53.898263 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e5c382e5-993d-4326-b100-c92a3a7be2f8 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:53.898924 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e5c382e5-993d-4326-b100-c92a3a7be2f8 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:53.899448 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e5c382e5-993d-4326-b100-c92a3a7be2f8 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:54.121727 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e5c382e5-993d-4326-b100-c92a3a7be2f8 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:54.133205 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e5c382e5-993d-4326-b100-c92a3a7be2f8 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1672 microversion: 2.1 time: 0.248016 Oct 14 13:03:54.134646 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 228/461] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:53 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1672 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:54.424645 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6234895c-7b8b-4c7b-be63-1b14515d00e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:54.425355 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-6234895c-7b8b-4c7b-be63-1b14515d00e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:54.436627 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6234895c-7b8b-4c7b-be63-1b14515d00e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:54.437446 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6234895c-7b8b-4c7b-be63-1b14515d00e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:54.437600 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6234895c-7b8b-4c7b-be63-1b14515d00e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:54.438284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6234895c-7b8b-4c7b-be63-1b14515d00e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:54.438738 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6234895c-7b8b-4c7b-be63-1b14515d00e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:54.439255 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6234895c-7b8b-4c7b-be63-1b14515d00e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:54.522012 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-2edce0a1-7f30-4859-aa2d-55be6ba05157 req-d136b755-5055-4d2f-8ff3-3a680118cc83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8f2bb08-a11d-46c6-96f5-9a9f85316fd0", "name": "network-vif-deleted", "tag": "e3f9c588-4549-470d-90da-07db69916332"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:54.532357 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-2edce0a1-7f30-4859-aa2d-55be6ba05157 req-d136b755-5055-4d2f-8ff3-3a680118cc83 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:54.532668 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-6234895c-7b8b-4c7b-be63-1b14515d00e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:54.533332 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-2edce0a1-7f30-4859-aa2d-55be6ba05157 req-d136b755-5055-4d2f-8ff3-3a680118cc83 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:54.533933 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-2edce0a1-7f30-4859-aa2d-55be6ba05157 req-d136b755-5055-4d2f-8ff3-3a680118cc83 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:54.542891 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-6234895c-7b8b-4c7b-be63-1b14515d00e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:54.547984 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-6234895c-7b8b-4c7b-be63-1b14515d00e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:54.548541 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-2edce0a1-7f30-4859-aa2d-55be6ba05157 req-d136b755-5055-4d2f-8ff3-3a680118cc83 service nova] Creating event network-vif-deleted:e3f9c588-4549-470d-90da-07db69916332 for instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 on hv-cinder-82099 Oct 14 13:03:54.549430 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-6234895c-7b8b-4c7b-be63-1b14515d00e6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 200 len: 1656 microversion: 2.20 time: 0.128889 Oct 14 13:03:54.550041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 234/462] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:54 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 1656 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:03:54.562510 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-2edce0a1-7f30-4859-aa2d-55be6ba05157 req-d136b755-5055-4d2f-8ff3-3a680118cc83 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035795 Oct 14 13:03:54.562510 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 229/463] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:03:54.678935 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-2e5575ed-db90-44fa-87b1-2fe92d48d101 req-49dda140-6b44-4c86-b1f5-d42923fc7e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24c6dfd1-715d-4239-a767-32f2e2dcf892", "name": "network-vif-deleted", "tag": "ca20794f-a050-45d2-ac62-3d478950e906"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:54.708863 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-2e5575ed-db90-44fa-87b1-2fe92d48d101 req-49dda140-6b44-4c86-b1f5-d42923fc7e47 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:54.709897 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-2e5575ed-db90-44fa-87b1-2fe92d48d101 req-49dda140-6b44-4c86-b1f5-d42923fc7e47 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:54.714159 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-2e5575ed-db90-44fa-87b1-2fe92d48d101 req-49dda140-6b44-4c86-b1f5-d42923fc7e47 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:54.735503 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-2e5575ed-db90-44fa-87b1-2fe92d48d101 req-49dda140-6b44-4c86-b1f5-d42923fc7e47 service nova] Creating event network-vif-deleted:ca20794f-a050-45d2-ac62-3d478950e906 for instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 on hv-cinder-82099 Oct 14 13:03:54.751344 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-2e5575ed-db90-44fa-87b1-2fe92d48d101 req-49dda140-6b44-4c86-b1f5-d42923fc7e47 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076875 Oct 14 13:03:54.758526 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 235/464] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:03:55.162609 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-bf454a27-b7c5-4d1a-bb2e-4480a6819e65 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:55.163342 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-bf454a27-b7c5-4d1a-bb2e-4480a6819e65 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:55.170075 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bf454a27-b7c5-4d1a-bb2e-4480a6819e65 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:55.170579 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bf454a27-b7c5-4d1a-bb2e-4480a6819e65 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:55.171080 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bf454a27-b7c5-4d1a-bb2e-4480a6819e65 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:55.172055 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bf454a27-b7c5-4d1a-bb2e-4480a6819e65 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:55.172581 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bf454a27-b7c5-4d1a-bb2e-4480a6819e65 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:55.173077 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bf454a27-b7c5-4d1a-bb2e-4480a6819e65 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:55.221011 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bf454a27-b7c5-4d1a-bb2e-4480a6819e65 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:55.221630 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bf454a27-b7c5-4d1a-bb2e-4480a6819e65 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:55.222281 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bf454a27-b7c5-4d1a-bb2e-4480a6819e65 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:55.222949 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-bf454a27-b7c5-4d1a-bb2e-4480a6819e65 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lazy-loading 'fault' on Instance uuid 24c6dfd1-715d-4239-a767-32f2e2dcf892 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:03:55.279673 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-bf454a27-b7c5-4d1a-bb2e-4480a6819e65 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:55.297378 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-bf454a27-b7c5-4d1a-bb2e-4480a6819e65 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 200 len: 1326 microversion: 2.1 time: 0.142777 Oct 14 13:03:55.297997 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 230/465] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:55 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 1326 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:55.576494 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-baa5d5c6-2182-4914-afc6-e3779bc59b43 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:55.577246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-baa5d5c6-2182-4914-afc6-e3779bc59b43 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:55.584156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-baa5d5c6-2182-4914-afc6-e3779bc59b43 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:55.584652 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-baa5d5c6-2182-4914-afc6-e3779bc59b43 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:55.585262 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-baa5d5c6-2182-4914-afc6-e3779bc59b43 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:55.585991 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-baa5d5c6-2182-4914-afc6-e3779bc59b43 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:55.586444 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-baa5d5c6-2182-4914-afc6-e3779bc59b43 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:55.586868 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-baa5d5c6-2182-4914-afc6-e3779bc59b43 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:55.608283 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-baa5d5c6-2182-4914-afc6-e3779bc59b43 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] HTTP exception thrown: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-baa5d5c6-2182-4914-afc6-e3779bc59b43 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Request method failure captured: Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 HTTP/1.1 Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV2GLiiG5lpdVr87nMRGLhHjvG9ei2Ab2yw3BET05lehMn7lWxhZPJhvVW0QyPJg4zwHeSXoKeptZd3lPGMkrdYX7iZyT1b6IQTRIlkqOBTIsV2JzIOoraOorN2U4x-FyJl_VT4YPgsp6hcj_nK7QUE4JvrswjktokYorMze75tXYsA Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 5d716a28995942e788205c1ad1e83bb3 Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:03:55.610246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:03:55.612057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d716a28995942e788205c1ad1e83bb3", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:03:55.612057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:03:55.612057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 5d716a28995942e788205c1ad1e83bb3 Oct 14 13:03:55.612057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:03:55.612057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-AttachVolumeShelveTestJSON-1446019722-project Oct 14 13:03:55.612057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:03:55.612057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:03:55.612057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 26a54235fb424dfd825b2de9f7aaa006 Oct 14 13:03:55.612057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446019722-project Oct 14 13:03:55.612057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:03:55.612057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. Oct 14 13:03:55.612057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': 'f8f2bb08-a11d-46c6-96f5-9a9f85316fd0'} Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:03:55.613157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. Oct 14 13:03:55.614964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:03:55.616995 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-baa5d5c6-2182-4914-afc6-e3779bc59b43 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Returning 404 to user: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:03:55.618097 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-baa5d5c6-2182-4914-afc6-e3779bc59b43 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 404 len: 111 microversion: 2.20 time: 0.046530 Oct 14 13:03:55.619689 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 236/466] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:55 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 13:03:55.628294 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4a90f416-9e30-4d39-8a77-5ec243b51c2d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '.version_select at 0x7fbb81bc2f70>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:55.650807 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4a90f416-9e30-4d39-8a77-5ec243b51c2d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-580466469" status: 204 len: 0 microversion: 2.20 time: 0.026454 Oct 14 13:03:55.651395 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 231/467] 10.222.0.47 () {60 vars in 1259 bytes} [Fri Oct 14 13:03:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-580466469 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 14 13:03:56.299571 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d630ffc8-379f-4939-918c-0c410fd1878d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Action: 'create', calling method: .version_select at 0x7fbb81a61f70>, body: {"keypair": {"name": "tempest-keypair-1209670002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2oMsOsp765+bVRfNPQSd6oiQW3zSnqMiXfbscJmS8aodIRYONV4zJguSKYDIuq6difw17AwUQCHmeug6hNecyy1wu0wLj2d3+Kftt8PfGJmJ72K28oaB99AIzhiwigjQ=="}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:56.314706 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-d630ffc8-379f-4939-918c-0c410fd1878d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Getting quotas for project 5d716a28995942e788205c1ad1e83bb3. Resources: {'key_pairs'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:03:56.318581 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-d630ffc8-379f-4939-918c-0c410fd1878d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Getting quotas for user 26a54235fb424dfd825b2de9f7aaa006 and project 5d716a28995942e788205c1ad1e83bb3. Resources: {'key_pairs'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:03:56.325894 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5be45fa0-668c-4f48-a23a-210aacfc98b9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:56.326526 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5be45fa0-668c-4f48-a23a-210aacfc98b9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:56.332534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5be45fa0-668c-4f48-a23a-210aacfc98b9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:56.333023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5be45fa0-668c-4f48-a23a-210aacfc98b9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:56.333468 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5be45fa0-668c-4f48-a23a-210aacfc98b9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:56.334190 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5be45fa0-668c-4f48-a23a-210aacfc98b9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:56.334648 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5be45fa0-668c-4f48-a23a-210aacfc98b9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:56.335077 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5be45fa0-668c-4f48-a23a-210aacfc98b9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:56.341943 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-d630ffc8-379f-4939-918c-0c410fd1878d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046100 Oct 14 13:03:56.342781 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 237/468] 10.222.0.47 () {62 vars in 1200 bytes} [Fri Oct 14 13:03:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 14 13:03:56.349874 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-5be45fa0-668c-4f48-a23a-210aacfc98b9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] HTTP exception thrown: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5be45fa0-668c-4f48-a23a-210aacfc98b9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Request method failure captured: Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 HTTP/1.1 Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1HBUZaj6qRN2kRRFOvEY7z6dWuDYr5fFNGR_t53BP1T_JHiNympyoIAtUV5VZh-RC7R8oc7LI2vtkXV6O-toJaLdv6AjTEMVya3A2r_PlPazlMIKGkh3ds1IdnF3btBZfykjpjCwVi87WsZEZUblAgouGF1iuBmm5iCnqMk6hEeGs Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 9247e549c63f4a42be20f5a7aeda0594 Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:03:56.351534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:03:56.353092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9247e549c63f4a42be20f5a7aeda0594", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:03:56.353092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:03:56.353092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 9247e549c63f4a42be20f5a7aeda0594 Oct 14 13:03:56.353092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:03:56.353092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-AttachVolumeTestJSON-974348523-project Oct 14 13:03:56.353092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:03:56.353092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:03:56.353092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 9394667740f44bcab24ee484b195fe96 Oct 14 13:03:56.353092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-AttachVolumeTestJSON-974348523-project Oct 14 13:03:56.353092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:03:56.353092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. Oct 14 13:03:56.353092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '24c6dfd1-715d-4239-a767-32f2e2dcf892'} Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:03:56.354093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. Oct 14 13:03:56.355620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:03:56.356981 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5be45fa0-668c-4f48-a23a-210aacfc98b9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Returning 404 to user: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:03:56.356981 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5be45fa0-668c-4f48-a23a-210aacfc98b9 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 404 len: 111 microversion: 2.1 time: 0.031405 Oct 14 13:03:56.356981 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 232/469] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:56 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 13:03:56.362148 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-24d08305-325a-494c-84c7-215375ec521a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '.version_select at 0x7fbb81bd7160>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:56.382082 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-24d08305-325a-494c-84c7-215375ec521a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-68197082" status: 202 len: 0 microversion: 2.1 time: 0.024229 Oct 14 13:03:56.383067 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 238/470] 10.222.0.47 () {58 vars in 1215 bytes} [Fri Oct 14 13:03:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-68197082 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:03:57.034313 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-b0ea5bcc-ac26-49fc-8e02-0d9db04d662c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Action: 'create', calling method: .version_select at 0x7fbb81b1df70>, body: {"keypair": {"name": "tempest-keypair-1001251075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGyr4q5/7mFbWlTKMYEwgo3IHE7to9frAo0LGWmRm2qKtK3QEbK+KzAN4IgZf1/1Xe+Z8fHr6tRocLCAKLB1fx3XbUkPxKmzPQy4ELoAJ060Zj/T1dcN9IgdrA/WXbyCg=="}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:57.049925 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-b0ea5bcc-ac26-49fc-8e02-0d9db04d662c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Getting quotas for project 9247e549c63f4a42be20f5a7aeda0594. Resources: {'key_pairs'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:03:57.053860 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-b0ea5bcc-ac26-49fc-8e02-0d9db04d662c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Getting quotas for user 9394667740f44bcab24ee484b195fe96 and project 9247e549c63f4a42be20f5a7aeda0594. Resources: {'key_pairs'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:03:57.076068 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-b0ea5bcc-ac26-49fc-8e02-0d9db04d662c tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045553 Oct 14 13:03:57.076666 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 233/471] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Oct 14 13:03:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:03:57.678882 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1092076783", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d80192b0-2cb7-4b32-acc8-b8489f9d8a8b"}], "security_groups": [{"name": "tempest-securitygroup--749973248"}], "key_name": "tempest-keypair-1209670002", "user_data": "}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:57.836858 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.network.neutron [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] validate_networks() for [('d80192b0-2cb7-4b32-acc8-b8489f9d8a8b', None, None, None, None, None)] {{(pid=118868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:03:58.673550 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Flavor limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:03:58.674004 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Image limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:03:58.674499 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Flavor pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:03:58.674909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Image pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:03:58.675329 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:03:58.685146 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:58.685778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:58.686106 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:58.686831 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:58.687285 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:58.687714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:58.705254 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Getting quotas for project 5d716a28995942e788205c1ad1e83bb3. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:03:58.709263 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Getting quotas for user 26a54235fb424dfd825b2de9f7aaa006 and project 5d716a28995942e788205c1ad1e83bb3. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:03:58.722926 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Going to run 1 instances... {{(pid=118868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:03:58.725260 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:03:58.773335 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-cf3750d3-1662-4f1b-8f56-c965b9f04690 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.099335 Oct 14 13:03:58.774339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 239/472] 10.222.0.47 () {62 vars in 1188 bytes} [Fri Oct 14 13:03:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 14 13:03:58.787073 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7fc23e50-e36c-443a-b936-9e6a845b44b6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:58.787743 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7fc23e50-e36c-443a-b936-9e6a845b44b6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:58.858629 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7fc23e50-e36c-443a-b936-9e6a845b44b6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:58.870062 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7fc23e50-e36c-443a-b936-9e6a845b44b6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:58.871836 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7fc23e50-e36c-443a-b936-9e6a845b44b6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:58.872943 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7fc23e50-e36c-443a-b936-9e6a845b44b6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1282 microversion: 2.20 time: 0.091229 Oct 14 13:03:58.873504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 234/473] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:58 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:03:58.923949 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1950322268", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "19221892-26e2-485e-83b6-c9b12590cb03"}], "security_groups": [{"name": "tempest-securitygroup--180034773"}], "key_name": "tempest-keypair-1001251075", "user_data": "}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:03:59.027143 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.network.neutron [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] validate_networks() for [('19221892-26e2-485e-83b6-c9b12590cb03', None, None, None, None, None)] {{(pid=118868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:03:59.409287 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Flavor limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:03:59.409748 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Image limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:03:59.410227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Flavor pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:03:59.410639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Image pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:03:59.411056 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:03:59.420539 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:59.421192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:59.421820 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:59.423174 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:59.423838 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:59.424304 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:59.441355 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Getting quotas for project 9247e549c63f4a42be20f5a7aeda0594. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:03:59.445157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Getting quotas for user 9394667740f44bcab24ee484b195fe96 and project 9247e549c63f4a42be20f5a7aeda0594. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:03:59.456654 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Going to run 1 instances... {{(pid=118868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:03:59.458862 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:03:59.512417 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c7ee3e8c-7159-4d42-8d87-8c69e69965dd tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.593159 Oct 14 13:03:59.513180 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 240/474] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:03:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 13:03:59.524891 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8bf6234c-0ed7-4340-873a-15342009573e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:59.525536 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8bf6234c-0ed7-4340-873a-15342009573e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:59.579834 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8bf6234c-0ed7-4340-873a-15342009573e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:59.588886 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8bf6234c-0ed7-4340-873a-15342009573e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1238 microversion: 2.1 time: 0.068529 Oct 14 13:03:59.589835 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 235/475] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:03:59 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:03:59.898814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c639bd13-1884-4fa6-9044-821affff3961 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:03:59.900016 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c639bd13-1884-4fa6-9044-821affff3961 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:03:59.906140 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c639bd13-1884-4fa6-9044-821affff3961 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:59.906625 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c639bd13-1884-4fa6-9044-821affff3961 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:59.907058 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c639bd13-1884-4fa6-9044-821affff3961 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:59.907747 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c639bd13-1884-4fa6-9044-821affff3961 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:03:59.908197 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c639bd13-1884-4fa6-9044-821affff3961 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:03:59.908620 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c639bd13-1884-4fa6-9044-821affff3961 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:03:59.977003 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c639bd13-1884-4fa6-9044-821affff3961 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:59.987334 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c639bd13-1884-4fa6-9044-821affff3961 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:59.988880 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c639bd13-1884-4fa6-9044-821affff3961 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:03:59.991080 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c639bd13-1884-4fa6-9044-821affff3961 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1334 microversion: 2.20 time: 0.096815 Oct 14 13:03:59.992267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 241/476] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:03:59 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:04:00.612961 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-bd473cdd-e7ba-470a-b136-93fd69aa8b17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:00.613688 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-bd473cdd-e7ba-470a-b136-93fd69aa8b17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:00.623269 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bd473cdd-e7ba-470a-b136-93fd69aa8b17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:00.623762 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bd473cdd-e7ba-470a-b136-93fd69aa8b17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:00.624202 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bd473cdd-e7ba-470a-b136-93fd69aa8b17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:00.624902 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bd473cdd-e7ba-470a-b136-93fd69aa8b17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:00.625349 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bd473cdd-e7ba-470a-b136-93fd69aa8b17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:00.625823 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bd473cdd-e7ba-470a-b136-93fd69aa8b17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:00.705977 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-bd473cdd-e7ba-470a-b136-93fd69aa8b17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:00.715081 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-bd473cdd-e7ba-470a-b136-93fd69aa8b17 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1290 microversion: 2.1 time: 0.106671 Oct 14 13:04:00.716528 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 236/477] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:00 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1290 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:01.018961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e7532d38-b021-425c-a2a1-1393042f3622 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:01.019574 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e7532d38-b021-425c-a2a1-1393042f3622 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:01.026933 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e7532d38-b021-425c-a2a1-1393042f3622 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:01.027426 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e7532d38-b021-425c-a2a1-1393042f3622 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:01.027866 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e7532d38-b021-425c-a2a1-1393042f3622 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:01.028563 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e7532d38-b021-425c-a2a1-1393042f3622 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:01.029015 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e7532d38-b021-425c-a2a1-1393042f3622 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:01.029441 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e7532d38-b021-425c-a2a1-1393042f3622 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:01.255766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e7532d38-b021-425c-a2a1-1393042f3622 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:01.264748 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e7532d38-b021-425c-a2a1-1393042f3622 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:01.266324 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e7532d38-b021-425c-a2a1-1393042f3622 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:01.267841 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e7532d38-b021-425c-a2a1-1393042f3622 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1407 microversion: 2.20 time: 0.252644 Oct 14 13:04:01.268436 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 242/478] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:01 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:04:01.599403 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-43ffff0b-3a45-4c04-9333-5c15333a2561 req-a94f1b52-5aee-48ba-b6e4-a2a90f4d6e58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bff20a0-76b8-44e6-9f5c-87a9fce18f87", "tag": "096cc001-9ca8-472a-8f3d-2a345a805218"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:01.631970 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-43ffff0b-3a45-4c04-9333-5c15333a2561 req-a94f1b52-5aee-48ba-b6e4-a2a90f4d6e58 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:01.632659 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-43ffff0b-3a45-4c04-9333-5c15333a2561 req-a94f1b52-5aee-48ba-b6e4-a2a90f4d6e58 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:01.633403 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-43ffff0b-3a45-4c04-9333-5c15333a2561 req-a94f1b52-5aee-48ba-b6e4-a2a90f4d6e58 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:01.650999 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-43ffff0b-3a45-4c04-9333-5c15333a2561 req-a94f1b52-5aee-48ba-b6e4-a2a90f4d6e58 service nova] Creating event network-changed:096cc001-9ca8-472a-8f3d-2a345a805218 for instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 on hv-cinder-82099 Oct 14 13:04:01.657330 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-43ffff0b-3a45-4c04-9333-5c15333a2561 req-a94f1b52-5aee-48ba-b6e4-a2a90f4d6e58 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072372 Oct 14 13:04:01.658400 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 237/479] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:01.740579 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4385f782-18f4-4c5f-b5de-9a16627cafca tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:01.741585 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-4385f782-18f4-4c5f-b5de-9a16627cafca tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:01.748457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4385f782-18f4-4c5f-b5de-9a16627cafca tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:01.749374 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4385f782-18f4-4c5f-b5de-9a16627cafca tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:01.754033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4385f782-18f4-4c5f-b5de-9a16627cafca tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:01.755062 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4385f782-18f4-4c5f-b5de-9a16627cafca tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:01.755622 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4385f782-18f4-4c5f-b5de-9a16627cafca tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:01.756113 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4385f782-18f4-4c5f-b5de-9a16627cafca tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:01.975940 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-4385f782-18f4-4c5f-b5de-9a16627cafca tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:01.989436 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4385f782-18f4-4c5f-b5de-9a16627cafca tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1363 microversion: 2.1 time: 0.251786 Oct 14 13:04:01.990070 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 243/480] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:01 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:02.294527 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-54cf50d9-da22-4f58-b535-168cf79386d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:02.295232 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-54cf50d9-da22-4f58-b535-168cf79386d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:02.301647 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54cf50d9-da22-4f58-b535-168cf79386d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:02.302156 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54cf50d9-da22-4f58-b535-168cf79386d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:02.302593 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54cf50d9-da22-4f58-b535-168cf79386d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:02.303289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54cf50d9-da22-4f58-b535-168cf79386d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:02.303745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54cf50d9-da22-4f58-b535-168cf79386d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:02.304170 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54cf50d9-da22-4f58-b535-168cf79386d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:02.337297 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-97234465-3179-4019-bec1-d87a5503657e req-86c1055f-d624-418c-98b0-382b22083cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad4b0b2-2eb5-4754-89fc-8fab97ffd780", "tag": "80cb034b-1583-4a34-a888-d6a5a94739ed"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:02.347637 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-97234465-3179-4019-bec1-d87a5503657e req-86c1055f-d624-418c-98b0-382b22083cac service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:02.348117 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-97234465-3179-4019-bec1-d87a5503657e req-86c1055f-d624-418c-98b0-382b22083cac service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:02.348549 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-97234465-3179-4019-bec1-d87a5503657e req-86c1055f-d624-418c-98b0-382b22083cac service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:02.362738 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-97234465-3179-4019-bec1-d87a5503657e req-86c1055f-d624-418c-98b0-382b22083cac service nova] Creating event network-changed:80cb034b-1583-4a34-a888-d6a5a94739ed for instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 on hv-cinder-82099 Oct 14 13:04:02.367637 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-97234465-3179-4019-bec1-d87a5503657e req-86c1055f-d624-418c-98b0-382b22083cac service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033990 Oct 14 13:04:02.368434 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 244/481] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:04:02.473076 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-54cf50d9-da22-4f58-b535-168cf79386d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:02.481718 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-54cf50d9-da22-4f58-b535-168cf79386d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:02.483203 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-54cf50d9-da22-4f58-b535-168cf79386d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:02.484339 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-54cf50d9-da22-4f58-b535-168cf79386d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1407 microversion: 2.20 time: 0.194726 Oct 14 13:04:02.485159 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 238/482] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:02 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:04:03.014445 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7981af2b-c0ed-4db1-a245-10711cff5cce tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:03.015133 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-7981af2b-c0ed-4db1-a245-10711cff5cce tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:03.021775 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7981af2b-c0ed-4db1-a245-10711cff5cce tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:03.022253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7981af2b-c0ed-4db1-a245-10711cff5cce tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:03.022713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7981af2b-c0ed-4db1-a245-10711cff5cce tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:03.023589 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7981af2b-c0ed-4db1-a245-10711cff5cce tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:03.024096 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7981af2b-c0ed-4db1-a245-10711cff5cce tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:03.024517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7981af2b-c0ed-4db1-a245-10711cff5cce tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:03.044021 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:03.260341 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-7981af2b-c0ed-4db1-a245-10711cff5cce tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:03.268741 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7981af2b-c0ed-4db1-a245-10711cff5cce tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1363 microversion: 2.1 time: 0.258425 Oct 14 13:04:03.269509 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 245/483] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:03 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:03.509974 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4ec56b88-efb9-49e9-aa31-c2ac07447505 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:03.511786 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4ec56b88-efb9-49e9-aa31-c2ac07447505 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:03.518329 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4ec56b88-efb9-49e9-aa31-c2ac07447505 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:03.519352 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4ec56b88-efb9-49e9-aa31-c2ac07447505 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:03.519646 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4ec56b88-efb9-49e9-aa31-c2ac07447505 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:03.520540 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4ec56b88-efb9-49e9-aa31-c2ac07447505 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:03.521259 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4ec56b88-efb9-49e9-aa31-c2ac07447505 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:03.521893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4ec56b88-efb9-49e9-aa31-c2ac07447505 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:03.660796 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4ec56b88-efb9-49e9-aa31-c2ac07447505 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:03.669559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4ec56b88-efb9-49e9-aa31-c2ac07447505 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:03.671002 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4ec56b88-efb9-49e9-aa31-c2ac07447505 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:03.672110 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4ec56b88-efb9-49e9-aa31-c2ac07447505 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1407 microversion: 2.20 time: 0.166247 Oct 14 13:04:03.672652 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 239/484] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:03 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:04:04.292466 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-04887caf-565a-4aaf-968f-4ed7f0c29da1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:04.293059 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-04887caf-565a-4aaf-968f-4ed7f0c29da1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:04.299462 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04887caf-565a-4aaf-968f-4ed7f0c29da1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:04.299941 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04887caf-565a-4aaf-968f-4ed7f0c29da1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:04.300367 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04887caf-565a-4aaf-968f-4ed7f0c29da1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:04.301042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04887caf-565a-4aaf-968f-4ed7f0c29da1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:04.301549 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04887caf-565a-4aaf-968f-4ed7f0c29da1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:04.301967 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04887caf-565a-4aaf-968f-4ed7f0c29da1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:04.432657 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-04887caf-565a-4aaf-968f-4ed7f0c29da1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:04.440361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-04887caf-565a-4aaf-968f-4ed7f0c29da1 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1363 microversion: 2.1 time: 0.152352 Oct 14 13:04:04.440921 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 246/485] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:04 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:04.697744 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-64543721-9889-4e1f-bc56-2acc42ed6312 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:04.698371 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-64543721-9889-4e1f-bc56-2acc42ed6312 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:04.704322 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-64543721-9889-4e1f-bc56-2acc42ed6312 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:04.704797 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-64543721-9889-4e1f-bc56-2acc42ed6312 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:04.705223 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-64543721-9889-4e1f-bc56-2acc42ed6312 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:04.705928 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-64543721-9889-4e1f-bc56-2acc42ed6312 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:04.706371 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-64543721-9889-4e1f-bc56-2acc42ed6312 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:04.706787 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-64543721-9889-4e1f-bc56-2acc42ed6312 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:04.832619 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-64543721-9889-4e1f-bc56-2acc42ed6312 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:04.840673 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-64543721-9889-4e1f-bc56-2acc42ed6312 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:04.842154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-64543721-9889-4e1f-bc56-2acc42ed6312 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:04.843249 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-64543721-9889-4e1f-bc56-2acc42ed6312 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1407 microversion: 2.20 time: 0.149906 Oct 14 13:04:04.843828 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 240/486] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:04 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:04:05.465107 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-33e37981-237d-44e0-8421-4e9ac82d7d1b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:05.466162 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-33e37981-237d-44e0-8421-4e9ac82d7d1b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:05.473708 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33e37981-237d-44e0-8421-4e9ac82d7d1b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:05.473953 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33e37981-237d-44e0-8421-4e9ac82d7d1b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:05.474588 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33e37981-237d-44e0-8421-4e9ac82d7d1b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:05.475515 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33e37981-237d-44e0-8421-4e9ac82d7d1b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:05.476035 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33e37981-237d-44e0-8421-4e9ac82d7d1b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:05.476570 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33e37981-237d-44e0-8421-4e9ac82d7d1b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:05.611246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-33e37981-237d-44e0-8421-4e9ac82d7d1b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:05.618939 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-33e37981-237d-44e0-8421-4e9ac82d7d1b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1363 microversion: 2.1 time: 0.158721 Oct 14 13:04:05.619601 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 247/487] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:05 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:05.697887 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-63422afe-8a76-415b-afa7-e3381e59821a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:05.698554 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-63422afe-8a76-415b-afa7-e3381e59821a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:05.704460 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-63422afe-8a76-415b-afa7-e3381e59821a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:05.704942 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-63422afe-8a76-415b-afa7-e3381e59821a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:05.705374 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-63422afe-8a76-415b-afa7-e3381e59821a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:05.706091 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-63422afe-8a76-415b-afa7-e3381e59821a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:05.706545 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-63422afe-8a76-415b-afa7-e3381e59821a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:05.706997 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-63422afe-8a76-415b-afa7-e3381e59821a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:05.788120 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-63422afe-8a76-415b-afa7-e3381e59821a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lazy-loading 'services' on Instance uuid ac1bf768-41b1-41c6-9621-d0aaead003e5 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:04:05.860606 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-63422afe-8a76-415b-afa7-e3381e59821a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/os-volume_attachments/c432df6d-01c3-42cf-8865-66387bcf439f" status: 202 len: 0 microversion: 2.1 time: 0.166784 Oct 14 13:04:05.861226 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 241/488] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Oct 14 13:04:05 2022] DELETE /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/os-volume_attachments/c432df6d-01c3-42cf-8865-66387bcf439f => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:04:05.868208 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-62f57e6d-7b37-489f-89ba-d7ac5ea10fa9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:05.869564 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-62f57e6d-7b37-489f-89ba-d7ac5ea10fa9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:05.870481 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-16e59fd8-bc11-4876-9401-13a350942032 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:05.872739 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:05.872887 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-16e59fd8-bc11-4876-9401-13a350942032 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:05.876829 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-62f57e6d-7b37-489f-89ba-d7ac5ea10fa9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:05.877524 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-62f57e6d-7b37-489f-89ba-d7ac5ea10fa9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:05.878024 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-62f57e6d-7b37-489f-89ba-d7ac5ea10fa9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:05.878674 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-62f57e6d-7b37-489f-89ba-d7ac5ea10fa9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:05.879134 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-62f57e6d-7b37-489f-89ba-d7ac5ea10fa9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:05.879472 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-16e59fd8-bc11-4876-9401-13a350942032 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:05.879608 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-62f57e6d-7b37-489f-89ba-d7ac5ea10fa9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:05.879953 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-16e59fd8-bc11-4876-9401-13a350942032 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:05.880391 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-16e59fd8-bc11-4876-9401-13a350942032 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:05.881102 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-16e59fd8-bc11-4876-9401-13a350942032 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:05.881567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-16e59fd8-bc11-4876-9401-13a350942032 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:05.881966 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-16e59fd8-bc11-4876-9401-13a350942032 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:05.907844 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:05.913126 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-16e59fd8-bc11-4876-9401-13a350942032 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047444 Oct 14 13:04:05.913695 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 242/489] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:04:05 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:04:06.013391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-62f57e6d-7b37-489f-89ba-d7ac5ea10fa9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:06.021801 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-62f57e6d-7b37-489f-89ba-d7ac5ea10fa9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:06.023258 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-62f57e6d-7b37-489f-89ba-d7ac5ea10fa9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:06.024398 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-62f57e6d-7b37-489f-89ba-d7ac5ea10fa9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1407 microversion: 2.20 time: 0.160249 Oct 14 13:04:06.025002 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 248/490] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:05 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:04:06.641657 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8d7f0cf7-dc96-41ca-ad97-e87f1885d51a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:06.642798 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8d7f0cf7-dc96-41ca-ad97-e87f1885d51a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:06.651626 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d7f0cf7-dc96-41ca-ad97-e87f1885d51a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:06.652117 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d7f0cf7-dc96-41ca-ad97-e87f1885d51a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:06.652554 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d7f0cf7-dc96-41ca-ad97-e87f1885d51a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:06.653287 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d7f0cf7-dc96-41ca-ad97-e87f1885d51a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:06.653731 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d7f0cf7-dc96-41ca-ad97-e87f1885d51a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:06.654152 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d7f0cf7-dc96-41ca-ad97-e87f1885d51a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:06.790286 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8d7f0cf7-dc96-41ca-ad97-e87f1885d51a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:06.797989 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8d7f0cf7-dc96-41ca-ad97-e87f1885d51a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1363 microversion: 2.1 time: 0.160482 Oct 14 13:04:06.798545 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 243/491] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:06 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:06.926145 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c59f95f9-0af3-43dc-804e-8d288ef0500f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:06.928266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c59f95f9-0af3-43dc-804e-8d288ef0500f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:06.934623 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c59f95f9-0af3-43dc-804e-8d288ef0500f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:06.935100 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c59f95f9-0af3-43dc-804e-8d288ef0500f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:06.935530 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c59f95f9-0af3-43dc-804e-8d288ef0500f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:06.936208 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c59f95f9-0af3-43dc-804e-8d288ef0500f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:06.936654 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c59f95f9-0af3-43dc-804e-8d288ef0500f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:06.937070 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c59f95f9-0af3-43dc-804e-8d288ef0500f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:06.965847 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c59f95f9-0af3-43dc-804e-8d288ef0500f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043555 Oct 14 13:04:06.966395 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 249/492] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:04:06 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 13:04:07.040682 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-dc79bd0d-9b6f-4c08-b7d8-77c9e1e06a5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:07.041169 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-dc79bd0d-9b6f-4c08-b7d8-77c9e1e06a5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:07.047140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dc79bd0d-9b6f-4c08-b7d8-77c9e1e06a5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:07.047618 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dc79bd0d-9b6f-4c08-b7d8-77c9e1e06a5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:07.048047 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dc79bd0d-9b6f-4c08-b7d8-77c9e1e06a5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:07.048730 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dc79bd0d-9b6f-4c08-b7d8-77c9e1e06a5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:07.049174 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dc79bd0d-9b6f-4c08-b7d8-77c9e1e06a5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:07.049422 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e8dfef7e-953a-49e7-963c-04c5a4cce629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:07.049616 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dc79bd0d-9b6f-4c08-b7d8-77c9e1e06a5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:07.050071 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e8dfef7e-953a-49e7-963c-04c5a4cce629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:07.056662 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e8dfef7e-953a-49e7-963c-04c5a4cce629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:07.057156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e8dfef7e-953a-49e7-963c-04c5a4cce629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:07.057645 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e8dfef7e-953a-49e7-963c-04c5a4cce629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:07.058344 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e8dfef7e-953a-49e7-963c-04c5a4cce629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:07.058921 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e8dfef7e-953a-49e7-963c-04c5a4cce629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:07.059357 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e8dfef7e-953a-49e7-963c-04c5a4cce629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:07.075424 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-dc79bd0d-9b6f-4c08-b7d8-77c9e1e06a5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Going to try to terminate instance {{(pid=118869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:04:07.153610 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-dc79bd0d-9b6f-4c08-b7d8-77c9e1e06a5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 204 len: 0 microversion: 2.1 time: 0.116369 Oct 14 13:04:07.154592 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 244/493] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:04:07 2022] DELETE /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:04:07.162626 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f737c6ae-1c11-4729-9d75-ee97c72e600b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:07.163324 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f737c6ae-1c11-4729-9d75-ee97c72e600b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:07.169334 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f737c6ae-1c11-4729-9d75-ee97c72e600b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:07.169860 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f737c6ae-1c11-4729-9d75-ee97c72e600b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:07.170299 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f737c6ae-1c11-4729-9d75-ee97c72e600b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:07.170992 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f737c6ae-1c11-4729-9d75-ee97c72e600b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:07.171442 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f737c6ae-1c11-4729-9d75-ee97c72e600b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:07.171862 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f737c6ae-1c11-4729-9d75-ee97c72e600b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:07.194203 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e8dfef7e-953a-49e7-963c-04c5a4cce629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:07.203275 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e8dfef7e-953a-49e7-963c-04c5a4cce629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:07.204739 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e8dfef7e-953a-49e7-963c-04c5a4cce629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:07.206019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e8dfef7e-953a-49e7-963c-04c5a4cce629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1407 microversion: 2.20 time: 0.160456 Oct 14 13:04:07.206590 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 250/494] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:07 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:04:07.307467 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f737c6ae-1c11-4729-9d75-ee97c72e600b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:07.315234 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-f737c6ae-1c11-4729-9d75-ee97c72e600b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1687 microversion: 2.1 time: 0.156665 Oct 14 13:04:07.315836 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 245/495] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:07 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:07.742609 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-4e3b8989-5fae-4da8-bb09-ce8be792abcc req-a9b2ba8c-b66c-4827-b77f-f90807b5f860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad4b0b2-2eb5-4754-89fc-8fab97ffd780", "name": "network-vif-plugged", "status": "completed", "tag": "80cb034b-1583-4a34-a888-d6a5a94739ed"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:07.753419 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-4e3b8989-5fae-4da8-bb09-ce8be792abcc req-a9b2ba8c-b66c-4827-b77f-f90807b5f860 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:07.754520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-4e3b8989-5fae-4da8-bb09-ce8be792abcc req-a9b2ba8c-b66c-4827-b77f-f90807b5f860 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:07.754923 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-4e3b8989-5fae-4da8-bb09-ce8be792abcc req-a9b2ba8c-b66c-4827-b77f-f90807b5f860 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:07.766827 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-4e3b8989-5fae-4da8-bb09-ce8be792abcc req-a9b2ba8c-b66c-4827-b77f-f90807b5f860 service nova] Creating event network-vif-plugged:80cb034b-1583-4a34-a888-d6a5a94739ed for instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 on hv-cinder-82099 Oct 14 13:04:07.771741 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-4e3b8989-5fae-4da8-bb09-ce8be792abcc req-a9b2ba8c-b66c-4827-b77f-f90807b5f860 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032931 Oct 14 13:04:07.772332 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 251/496] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:07.820391 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7bb95434-d875-4cd2-b478-f46f77250343 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:07.821102 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7bb95434-d875-4cd2-b478-f46f77250343 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:07.827210 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bb95434-d875-4cd2-b478-f46f77250343 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:07.827799 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bb95434-d875-4cd2-b478-f46f77250343 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:07.828306 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bb95434-d875-4cd2-b478-f46f77250343 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:07.829108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bb95434-d875-4cd2-b478-f46f77250343 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:07.829694 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bb95434-d875-4cd2-b478-f46f77250343 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:07.830216 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7bb95434-d875-4cd2-b478-f46f77250343 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:07.968152 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7bb95434-d875-4cd2-b478-f46f77250343 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:07.976511 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7bb95434-d875-4cd2-b478-f46f77250343 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1363 microversion: 2.1 time: 0.160064 Oct 14 13:04:07.977100 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 246/497] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:07 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:08.152140 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d906b931-d1d6-4947-af69-0c7a35ede02a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:08.152722 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-d906b931-d1d6-4947-af69-0c7a35ede02a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:08.158969 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d906b931-d1d6-4947-af69-0c7a35ede02a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:08.159462 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d906b931-d1d6-4947-af69-0c7a35ede02a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:08.159922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d906b931-d1d6-4947-af69-0c7a35ede02a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:08.160592 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d906b931-d1d6-4947-af69-0c7a35ede02a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:08.161047 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d906b931-d1d6-4947-af69-0c7a35ede02a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:08.161472 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d906b931-d1d6-4947-af69-0c7a35ede02a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:08.186787 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-d906b931-d1d6-4947-af69-0c7a35ede02a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76/ips" status: 200 len: 150 microversion: 2.1 time: 0.039289 Oct 14 13:04:08.187272 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 252/498] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Oct 14 13:04:08 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:08.231971 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8fa375ef-71da-4c1e-81ec-22a3e1e6c6b3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:08.232664 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8fa375ef-71da-4c1e-81ec-22a3e1e6c6b3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:08.238848 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fa375ef-71da-4c1e-81ec-22a3e1e6c6b3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:08.239499 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fa375ef-71da-4c1e-81ec-22a3e1e6c6b3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:08.239824 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fa375ef-71da-4c1e-81ec-22a3e1e6c6b3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:08.240555 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fa375ef-71da-4c1e-81ec-22a3e1e6c6b3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:08.241012 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fa375ef-71da-4c1e-81ec-22a3e1e6c6b3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:08.241436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fa375ef-71da-4c1e-81ec-22a3e1e6c6b3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:08.339007 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-82204e0b-d6d6-464d-a763-99302c78e035 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:08.339882 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-82204e0b-d6d6-464d-a763-99302c78e035 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:08.346418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-82204e0b-d6d6-464d-a763-99302c78e035 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:08.346915 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-82204e0b-d6d6-464d-a763-99302c78e035 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:08.347563 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-82204e0b-d6d6-464d-a763-99302c78e035 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:08.348395 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-82204e0b-d6d6-464d-a763-99302c78e035 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:08.348930 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-82204e0b-d6d6-464d-a763-99302c78e035 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:08.349370 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-82204e0b-d6d6-464d-a763-99302c78e035 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:08.377285 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8fa375ef-71da-4c1e-81ec-22a3e1e6c6b3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:08.386665 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8fa375ef-71da-4c1e-81ec-22a3e1e6c6b3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:08.388103 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8fa375ef-71da-4c1e-81ec-22a3e1e6c6b3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:08.389210 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8fa375ef-71da-4c1e-81ec-22a3e1e6c6b3 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1407 microversion: 2.20 time: 0.161705 Oct 14 13:04:08.389797 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 247/499] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:08 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:04:08.504595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-82204e0b-d6d6-464d-a763-99302c78e035 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:08.512913 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-82204e0b-d6d6-464d-a763-99302c78e035 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1687 microversion: 2.1 time: 0.178138 Oct 14 13:04:08.513544 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 253/500] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:08 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:09.000664 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-6c7edead-c3e9-4d17-9dd2-a6e989188a73 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:09.001265 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-6c7edead-c3e9-4d17-9dd2-a6e989188a73 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:09.007309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6c7edead-c3e9-4d17-9dd2-a6e989188a73 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:09.007784 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6c7edead-c3e9-4d17-9dd2-a6e989188a73 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:09.008210 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6c7edead-c3e9-4d17-9dd2-a6e989188a73 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:09.008890 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6c7edead-c3e9-4d17-9dd2-a6e989188a73 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:09.009354 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6c7edead-c3e9-4d17-9dd2-a6e989188a73 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:09.009807 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6c7edead-c3e9-4d17-9dd2-a6e989188a73 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:09.135559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-6c7edead-c3e9-4d17-9dd2-a6e989188a73 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:09.143323 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-6c7edead-c3e9-4d17-9dd2-a6e989188a73 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1363 microversion: 2.1 time: 0.146559 Oct 14 13:04:09.143879 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 248/501] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:08 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:09.414607 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-759a2edc-a9cf-4ed3-8aaf-ff5c2f8b1499 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:09.415245 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-759a2edc-a9cf-4ed3-8aaf-ff5c2f8b1499 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:09.422376 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-759a2edc-a9cf-4ed3-8aaf-ff5c2f8b1499 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:09.422802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-759a2edc-a9cf-4ed3-8aaf-ff5c2f8b1499 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:09.423230 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-759a2edc-a9cf-4ed3-8aaf-ff5c2f8b1499 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:09.423913 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-759a2edc-a9cf-4ed3-8aaf-ff5c2f8b1499 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:09.424362 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-759a2edc-a9cf-4ed3-8aaf-ff5c2f8b1499 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:09.424779 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-759a2edc-a9cf-4ed3-8aaf-ff5c2f8b1499 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:09.439498 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=4 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:09.454683 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=16 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:09.537064 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2e4c5b49-55ae-43f6-8439-8c46b37af4a3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:09.537870 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-2e4c5b49-55ae-43f6-8439-8c46b37af4a3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:09.544519 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2e4c5b49-55ae-43f6-8439-8c46b37af4a3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:09.545009 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2e4c5b49-55ae-43f6-8439-8c46b37af4a3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:09.545442 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2e4c5b49-55ae-43f6-8439-8c46b37af4a3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:09.546164 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2e4c5b49-55ae-43f6-8439-8c46b37af4a3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:09.546619 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2e4c5b49-55ae-43f6-8439-8c46b37af4a3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:09.547043 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2e4c5b49-55ae-43f6-8439-8c46b37af4a3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:09.558898 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-759a2edc-a9cf-4ed3-8aaf-ff5c2f8b1499 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:09.567317 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-759a2edc-a9cf-4ed3-8aaf-ff5c2f8b1499 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:09.568788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-759a2edc-a9cf-4ed3-8aaf-ff5c2f8b1499 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:09.569951 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-759a2edc-a9cf-4ed3-8aaf-ff5c2f8b1499 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1407 microversion: 2.20 time: 0.159309 Oct 14 13:04:09.570517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 254/502] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:09 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:04:09.576713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-08fe18d9-1133-46d9-905f-ba66f38f8c08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88512cf0-2259-410b-9e11-56e152f1c77c"}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:09.579322 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-08fe18d9-1133-46d9-905f-ba66f38f8c08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:09.585250 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=8 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:09.585494 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-08fe18d9-1133-46d9-905f-ba66f38f8c08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:09.586344 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-08fe18d9-1133-46d9-905f-ba66f38f8c08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:09.586480 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-08fe18d9-1133-46d9-905f-ba66f38f8c08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:09.587121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-08fe18d9-1133-46d9-905f-ba66f38f8c08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:09.588099 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-08fe18d9-1133-46d9-905f-ba66f38f8c08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:09.588538 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-08fe18d9-1133-46d9-905f-ba66f38f8c08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:09.682870 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-2e4c5b49-55ae-43f6-8439-8c46b37af4a3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:09.690500 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-2e4c5b49-55ae-43f6-8439-8c46b37af4a3 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1687 microversion: 2.1 time: 0.158231 Oct 14 13:04:09.691070 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 249/503] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:09 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:04:09.804578 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-3b382de7-f897-4f88-8b09-ea12d37f299c req-58d50aa5-9b05-4208-b316-31d8e9f44cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bff20a0-76b8-44e6-9f5c-87a9fce18f87", "name": "network-vif-plugged", "status": "completed", "tag": "096cc001-9ca8-472a-8f3d-2a345a805218"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:09.814003 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-3b382de7-f897-4f88-8b09-ea12d37f299c req-58d50aa5-9b05-4208-b316-31d8e9f44cdd service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:09.814473 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-3b382de7-f897-4f88-8b09-ea12d37f299c req-58d50aa5-9b05-4208-b316-31d8e9f44cdd service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:09.814894 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-3b382de7-f897-4f88-8b09-ea12d37f299c req-58d50aa5-9b05-4208-b316-31d8e9f44cdd service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:09.826361 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-3b382de7-f897-4f88-8b09-ea12d37f299c req-58d50aa5-9b05-4208-b316-31d8e9f44cdd service nova] Creating event network-vif-plugged:096cc001-9ca8-472a-8f3d-2a345a805218 for instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 on hv-cinder-82099 Oct 14 13:04:09.831513 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-3b382de7-f897-4f88-8b09-ea12d37f299c req-58d50aa5-9b05-4208-b316-31d8e9f44cdd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030546 Oct 14 13:04:09.832153 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 250/504] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:04:10.173414 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-3cb624a3-b4ad-4f14-9531-4b4d66981700 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:10.176490 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-3cb624a3-b4ad-4f14-9531-4b4d66981700 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:10.190402 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3cb624a3-b4ad-4f14-9531-4b4d66981700 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:10.191694 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3cb624a3-b4ad-4f14-9531-4b4d66981700 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:10.192917 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3cb624a3-b4ad-4f14-9531-4b4d66981700 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:10.193746 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3cb624a3-b4ad-4f14-9531-4b4d66981700 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:10.194205 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3cb624a3-b4ad-4f14-9531-4b4d66981700 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:10.194664 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3cb624a3-b4ad-4f14-9531-4b4d66981700 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:10.296371 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-08fe18d9-1133-46d9-905f-ba66f38f8c08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "POST /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.724439 Oct 14 13:04:10.297358 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 255/505] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Oct 14 13:04:09 2022] POST /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76/os-volume_attachments => generated 194 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:10.387740 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-3cb624a3-b4ad-4f14-9531-4b4d66981700 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:10.396265 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-3cb624a3-b4ad-4f14-9531-4b4d66981700 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1363 microversion: 2.1 time: 0.233538 Oct 14 13:04:10.396836 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 251/506] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:10 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:10.598072 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c1465786-1480-46d4-95a5-ac6d19614c59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:10.598768 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c1465786-1480-46d4-95a5-ac6d19614c59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:10.605444 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c1465786-1480-46d4-95a5-ac6d19614c59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:10.605945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c1465786-1480-46d4-95a5-ac6d19614c59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:10.606379 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c1465786-1480-46d4-95a5-ac6d19614c59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:10.607054 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c1465786-1480-46d4-95a5-ac6d19614c59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:10.607504 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c1465786-1480-46d4-95a5-ac6d19614c59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:10.607921 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c1465786-1480-46d4-95a5-ac6d19614c59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:10.713818 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-3c4ca143-a340-4030-b03b-c45e88e4bfe8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:10.714429 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-3c4ca143-a340-4030-b03b-c45e88e4bfe8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:10.721073 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3c4ca143-a340-4030-b03b-c45e88e4bfe8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:10.721573 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3c4ca143-a340-4030-b03b-c45e88e4bfe8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:10.722014 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3c4ca143-a340-4030-b03b-c45e88e4bfe8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:10.722749 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3c4ca143-a340-4030-b03b-c45e88e4bfe8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:10.723207 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3c4ca143-a340-4030-b03b-c45e88e4bfe8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:10.723634 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3c4ca143-a340-4030-b03b-c45e88e4bfe8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:10.741959 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c1465786-1480-46d4-95a5-ac6d19614c59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:10.750674 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c1465786-1480-46d4-95a5-ac6d19614c59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:10.752110 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c1465786-1480-46d4-95a5-ac6d19614c59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:10.753209 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c1465786-1480-46d4-95a5-ac6d19614c59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1407 microversion: 2.20 time: 0.159932 Oct 14 13:04:10.753795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 256/507] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:10 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:04:10.852948 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-3c4ca143-a340-4030-b03b-c45e88e4bfe8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:10.861170 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-3c4ca143-a340-4030-b03b-c45e88e4bfe8 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1687 microversion: 2.1 time: 0.151342 Oct 14 13:04:10.861768 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 252/508] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:10 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:04:11.420008 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-dbd0f37e-ae41-4d13-bb02-110c5f1ab75b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:11.420847 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-dbd0f37e-ae41-4d13-bb02-110c5f1ab75b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:11.428169 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dbd0f37e-ae41-4d13-bb02-110c5f1ab75b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:11.428660 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dbd0f37e-ae41-4d13-bb02-110c5f1ab75b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:11.429095 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dbd0f37e-ae41-4d13-bb02-110c5f1ab75b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:11.429846 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dbd0f37e-ae41-4d13-bb02-110c5f1ab75b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:11.430301 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dbd0f37e-ae41-4d13-bb02-110c5f1ab75b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:11.430737 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dbd0f37e-ae41-4d13-bb02-110c5f1ab75b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:11.628135 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-dbd0f37e-ae41-4d13-bb02-110c5f1ab75b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:11.636432 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-dbd0f37e-ae41-4d13-bb02-110c5f1ab75b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1363 microversion: 2.1 time: 0.220901 Oct 14 13:04:11.637118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 257/509] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:11 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:11.778493 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-3c67e8aa-0c26-4ce4-a1de-cc36c9ea0651 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:11.779003 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-3c67e8aa-0c26-4ce4-a1de-cc36c9ea0651 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:11.785145 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3c67e8aa-0c26-4ce4-a1de-cc36c9ea0651 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:11.785690 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3c67e8aa-0c26-4ce4-a1de-cc36c9ea0651 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:11.786146 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3c67e8aa-0c26-4ce4-a1de-cc36c9ea0651 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:11.786838 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3c67e8aa-0c26-4ce4-a1de-cc36c9ea0651 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:11.787565 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3c67e8aa-0c26-4ce4-a1de-cc36c9ea0651 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:11.787785 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3c67e8aa-0c26-4ce4-a1de-cc36c9ea0651 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:11.884830 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-19fad8c1-b785-4dfc-9f25-2c316e52e251 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:11.885566 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-19fad8c1-b785-4dfc-9f25-2c316e52e251 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:11.891699 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19fad8c1-b785-4dfc-9f25-2c316e52e251 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:11.892186 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19fad8c1-b785-4dfc-9f25-2c316e52e251 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:11.892848 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19fad8c1-b785-4dfc-9f25-2c316e52e251 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:11.893572 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19fad8c1-b785-4dfc-9f25-2c316e52e251 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:11.894182 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19fad8c1-b785-4dfc-9f25-2c316e52e251 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:11.894612 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19fad8c1-b785-4dfc-9f25-2c316e52e251 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:11.939442 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-3c67e8aa-0c26-4ce4-a1de-cc36c9ea0651 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:11.948576 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-3c67e8aa-0c26-4ce4-a1de-cc36c9ea0651 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:11.950152 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-3c67e8aa-0c26-4ce4-a1de-cc36c9ea0651 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:11.951333 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-3c67e8aa-0c26-4ce4-a1de-cc36c9ea0651 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1600 microversion: 2.20 time: 0.177469 Oct 14 13:04:11.951895 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 253/510] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:11 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1600 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:04:11.976197 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-07456b62-d6cf-41b5-a835-62855fab4f9f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:11.976813 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-07456b62-d6cf-41b5-a835-62855fab4f9f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:11.983654 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-19fad8c1-b785-4dfc-9f25-2c316e52e251 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:11.985284 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07456b62-d6cf-41b5-a835-62855fab4f9f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:11.985880 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07456b62-d6cf-41b5-a835-62855fab4f9f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:11.986387 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07456b62-d6cf-41b5-a835-62855fab4f9f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:11.987273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07456b62-d6cf-41b5-a835-62855fab4f9f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:11.988045 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07456b62-d6cf-41b5-a835-62855fab4f9f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:11.988570 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07456b62-d6cf-41b5-a835-62855fab4f9f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:11.995442 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-19fad8c1-b785-4dfc-9f25-2c316e52e251 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1620 microversion: 2.1 time: 0.115035 Oct 14 13:04:11.996109 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 258/511] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:11 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1620 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:12.000891 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-b1428ecb-a7f4-464c-8543-9d86ef8b6261 req-bd559852-af39-4be2-a09d-d300834390eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac1bf768-41b1-41c6-9621-d0aaead003e5", "name": "network-vif-deleted", "tag": "7f90ffc6-2d72-4ce5-b0ce-2855a620d1c5"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:12.014656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-b1428ecb-a7f4-464c-8543-9d86ef8b6261 req-bd559852-af39-4be2-a09d-d300834390eb service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:12.015304 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-b1428ecb-a7f4-464c-8543-9d86ef8b6261 req-bd559852-af39-4be2-a09d-d300834390eb service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:12.015833 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-b1428ecb-a7f4-464c-8543-9d86ef8b6261 req-bd559852-af39-4be2-a09d-d300834390eb service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:12.028078 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-b1428ecb-a7f4-464c-8543-9d86ef8b6261 req-bd559852-af39-4be2-a09d-d300834390eb service nova] Creating event network-vif-deleted:7f90ffc6-2d72-4ce5-b0ce-2855a620d1c5 for instance ac1bf768-41b1-41c6-9621-d0aaead003e5 on hv-cinder-82099 Oct 14 13:04:12.034241 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-b1428ecb-a7f4-464c-8543-9d86ef8b6261 req-bd559852-af39-4be2-a09d-d300834390eb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036722 Oct 14 13:04:12.035146 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 259/512] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:12.082867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-07456b62-d6cf-41b5-a835-62855fab4f9f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.110540 Oct 14 13:04:12.083780 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 254/513] 10.222.0.47 () {60 vars in 1316 bytes} [Fri Oct 14 13:04:11 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 13:04:12.662809 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-16a4d27b-58d1-4101-a00f-96477dd9c9f2 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:12.663518 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-16a4d27b-58d1-4101-a00f-96477dd9c9f2 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:12.669785 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-16a4d27b-58d1-4101-a00f-96477dd9c9f2 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:12.670273 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-16a4d27b-58d1-4101-a00f-96477dd9c9f2 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:12.670886 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-16a4d27b-58d1-4101-a00f-96477dd9c9f2 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:12.671669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-16a4d27b-58d1-4101-a00f-96477dd9c9f2 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:12.676369 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-16a4d27b-58d1-4101-a00f-96477dd9c9f2 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:12.677649 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-16a4d27b-58d1-4101-a00f-96477dd9c9f2 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:12.916942 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-16a4d27b-58d1-4101-a00f-96477dd9c9f2 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:12.925070 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-16a4d27b-58d1-4101-a00f-96477dd9c9f2 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1549 microversion: 2.1 time: 0.266931 Oct 14 13:04:12.926774 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 260/514] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:12 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1549 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:12.950665 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5f33bebe-b9fe-48b8-ba57-f5e1e20d7a8d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:12.951950 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5f33bebe-b9fe-48b8-ba57-f5e1e20d7a8d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:12.958309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5f33bebe-b9fe-48b8-ba57-f5e1e20d7a8d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:12.959043 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5f33bebe-b9fe-48b8-ba57-f5e1e20d7a8d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:12.959555 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5f33bebe-b9fe-48b8-ba57-f5e1e20d7a8d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:12.961041 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5f33bebe-b9fe-48b8-ba57-f5e1e20d7a8d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:12.961637 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5f33bebe-b9fe-48b8-ba57-f5e1e20d7a8d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:12.962195 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5f33bebe-b9fe-48b8-ba57-f5e1e20d7a8d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:13.018875 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-471dd82e-2c0d-438a-ad71-67768947b447 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:13.019917 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-471dd82e-2c0d-438a-ad71-67768947b447 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:13.026589 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-471dd82e-2c0d-438a-ad71-67768947b447 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:13.027298 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-471dd82e-2c0d-438a-ad71-67768947b447 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:13.027917 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-471dd82e-2c0d-438a-ad71-67768947b447 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:13.028802 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-471dd82e-2c0d-438a-ad71-67768947b447 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:13.029268 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-471dd82e-2c0d-438a-ad71-67768947b447 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:13.029726 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-471dd82e-2c0d-438a-ad71-67768947b447 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:13.048239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5f33bebe-b9fe-48b8-ba57-f5e1e20d7a8d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102477 Oct 14 13:04:13.048833 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 255/515] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Oct 14 13:04:12 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:13.077002 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-471dd82e-2c0d-438a-ad71-67768947b447 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:13.077827 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-471dd82e-2c0d-438a-ad71-67768947b447 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:13.078443 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-471dd82e-2c0d-438a-ad71-67768947b447 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:13.079011 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.objects.instance [None req-471dd82e-2c0d-438a-ad71-67768947b447 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lazy-loading 'fault' on Instance uuid ac1bf768-41b1-41c6-9621-d0aaead003e5 {{(pid=118868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:04:13.146157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-471dd82e-2c0d-438a-ad71-67768947b447 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:13.158027 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-471dd82e-2c0d-438a-ad71-67768947b447 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 200 len: 1335 microversion: 2.1 time: 0.143217 Oct 14 13:04:13.159289 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 261/516] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:13 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 1335 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:04:14.051855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-7c070157-f319-417d-991b-99506a7d724b req-05aef0be-21c8-4e2c-82e5-da586a4dbe39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bff20a0-76b8-44e6-9f5c-87a9fce18f87", "tag": "096cc001-9ca8-472a-8f3d-2a345a805218"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:14.062410 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-7c070157-f319-417d-991b-99506a7d724b req-05aef0be-21c8-4e2c-82e5-da586a4dbe39 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:14.062890 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-7c070157-f319-417d-991b-99506a7d724b req-05aef0be-21c8-4e2c-82e5-da586a4dbe39 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:14.063316 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-7c070157-f319-417d-991b-99506a7d724b req-05aef0be-21c8-4e2c-82e5-da586a4dbe39 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:14.075737 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-7c070157-f319-417d-991b-99506a7d724b req-05aef0be-21c8-4e2c-82e5-da586a4dbe39 service nova] Creating event network-changed:096cc001-9ca8-472a-8f3d-2a345a805218 for instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 on hv-cinder-82099 Oct 14 13:04:14.080943 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-7c070157-f319-417d-991b-99506a7d724b req-05aef0be-21c8-4e2c-82e5-da586a4dbe39 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032856 Oct 14 13:04:14.082124 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 256/517] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:14.180325 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7898e191-fcbe-4153-8b94-018da25d4394 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:14.181624 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-7898e191-fcbe-4153-8b94-018da25d4394 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ac1bf768-41b1-41c6-9621-d0aaead003e5] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:14.188146 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7898e191-fcbe-4153-8b94-018da25d4394 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:14.188642 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7898e191-fcbe-4153-8b94-018da25d4394 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:14.189079 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7898e191-fcbe-4153-8b94-018da25d4394 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:14.189814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7898e191-fcbe-4153-8b94-018da25d4394 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:14.190270 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7898e191-fcbe-4153-8b94-018da25d4394 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:14.190695 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7898e191-fcbe-4153-8b94-018da25d4394 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:14.195207 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:14.214436 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-7898e191-fcbe-4153-8b94-018da25d4394 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] HTTP exception thrown: Instance ac1bf768-41b1-41c6-9621-d0aaead003e5 could not be found. Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7898e191-fcbe-4153-8b94-018da25d4394 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Request method failure captured: Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 HTTP/1.1 Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV1Cs09Cu8vSps46z6W6PeSQaPlaz7RbycBpbAaKGyNLkJbBPIE899Agnc8xKbSQMAp8rE7tSu7AwxUpIowQS4vJkiL31SuEvGTrM_qnAchngAi6kRbyLURlB3MBaW58J1FeYinNbeUIsTaDmwhcpSEQThHsj_MktdqLjb4gv2tw8pQ Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: c160176d8c804b7793bae21c205c538c Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-284328419 Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:04:14.216922 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:04:14.218561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c160176d8c804b7793bae21c205c538c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c160176d8c804b7793bae21c205c538c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c160176d8c804b7793bae21c205c538c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c160176d8c804b7793bae21c205c538c", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:04:14.218561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-ServerRescueNegativeTestJSON-284328419 Oct 14 13:04:14.218561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: c160176d8c804b7793bae21c205c538c Oct 14 13:04:14.218561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-284328419 Oct 14 13:04:14.218561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-ServerRescueNegativeTestJSON-284328419-project Oct 14 13:04:14.218561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:04:14.218561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:04:14.218561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 60860294eb284b8aa11edd42dca4ae8d Oct 14 13:04:14.218561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-ServerRescueNegativeTestJSON-284328419-project Oct 14 13:04:14.218561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:04:14.218561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance ac1bf768-41b1-41c6-9621-d0aaead003e5 could not be found. Oct 14 13:04:14.218561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': 'ac1bf768-41b1-41c6-9621-d0aaead003e5'} Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac1bf768-41b1-41c6-9621-d0aaead003e5 could not be found. Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:04:14.219475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac1bf768-41b1-41c6-9621-d0aaead003e5 could not be found. Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac1bf768-41b1-41c6-9621-d0aaead003e5 could not be found. Oct 14 13:04:14.220937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:04:14.222253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7898e191-fcbe-4153-8b94-018da25d4394 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Returning 404 to user: Instance ac1bf768-41b1-41c6-9621-d0aaead003e5 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:04:14.222253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7898e191-fcbe-4153-8b94-018da25d4394 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5" status: 404 len: 111 microversion: 2.1 time: 0.043961 Oct 14 13:04:14.222253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 262/518] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:14 2022] GET /compute/v2.1/servers/ac1bf768-41b1-41c6-9621-d0aaead003e5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:04:14.233509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d4142016-f834-484c-8c03-f76b0b838f4d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '.version_select at 0x7fbb81ae6040>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:14.263377 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-d4142016-f834-484c-8c03-f76b0b838f4d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-433833009" status: 202 len: 0 microversion: 2.1 time: 0.037573 Oct 14 13:04:14.268549 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 257/519] 10.222.0.47 () {58 vars in 1218 bytes} [Fri Oct 14 13:04:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-433833009 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:04:14.348538 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-4f2e8b8d-eabd-41d4-b63f-cfe137f5639a req-51219d0f-b116-49a8-b37e-98cc73fb23d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad4b0b2-2eb5-4754-89fc-8fab97ffd780", "tag": "80cb034b-1583-4a34-a888-d6a5a94739ed"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:14.369555 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-4f2e8b8d-eabd-41d4-b63f-cfe137f5639a req-51219d0f-b116-49a8-b37e-98cc73fb23d2 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:14.370462 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-4f2e8b8d-eabd-41d4-b63f-cfe137f5639a req-51219d0f-b116-49a8-b37e-98cc73fb23d2 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:14.371866 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-4f2e8b8d-eabd-41d4-b63f-cfe137f5639a req-51219d0f-b116-49a8-b37e-98cc73fb23d2 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:14.396219 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-4f2e8b8d-eabd-41d4-b63f-cfe137f5639a req-51219d0f-b116-49a8-b37e-98cc73fb23d2 service nova] Creating event network-changed:80cb034b-1583-4a34-a888-d6a5a94739ed for instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 on hv-cinder-82099 Oct 14 13:04:14.404050 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-4f2e8b8d-eabd-41d4-b63f-cfe137f5639a req-51219d0f-b116-49a8-b37e-98cc73fb23d2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058892 Oct 14 13:04:14.405650 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 263/520] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:18.122193 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d8ac609e-afa1-4cd7-b5cd-ff2739245c8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:18.122800 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-d8ac609e-afa1-4cd7-b5cd-ff2739245c8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:18.125967 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:18.130094 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d8ac609e-afa1-4cd7-b5cd-ff2739245c8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:18.130588 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d8ac609e-afa1-4cd7-b5cd-ff2739245c8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:18.131016 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d8ac609e-afa1-4cd7-b5cd-ff2739245c8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:18.131696 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d8ac609e-afa1-4cd7-b5cd-ff2739245c8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:18.132143 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d8ac609e-afa1-4cd7-b5cd-ff2739245c8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:18.132560 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d8ac609e-afa1-4cd7-b5cd-ff2739245c8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:18.159586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-d8ac609e-afa1-4cd7-b5cd-ff2739245c8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Going to try to terminate instance {{(pid=118869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:04:18.237669 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-d8ac609e-afa1-4cd7-b5cd-ff2739245c8d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 204 len: 0 microversion: 2.1 time: 0.119544 Oct 14 13:04:18.238164 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 258/521] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:04:18 2022] DELETE /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:04:18.248325 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7f241c19-14e9-4d5d-b61f-0cf3a8b88c90 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:18.249043 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-7f241c19-14e9-4d5d-b61f-0cf3a8b88c90 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:18.255301 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7f241c19-14e9-4d5d-b61f-0cf3a8b88c90 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:18.255777 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7f241c19-14e9-4d5d-b61f-0cf3a8b88c90 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:18.256206 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7f241c19-14e9-4d5d-b61f-0cf3a8b88c90 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:18.256890 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7f241c19-14e9-4d5d-b61f-0cf3a8b88c90 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:18.257336 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7f241c19-14e9-4d5d-b61f-0cf3a8b88c90 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:18.257781 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7f241c19-14e9-4d5d-b61f-0cf3a8b88c90 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:18.387311 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-7f241c19-14e9-4d5d-b61f-0cf3a8b88c90 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:18.395509 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7f241c19-14e9-4d5d-b61f-0cf3a8b88c90 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1506 microversion: 2.1 time: 0.152638 Oct 14 13:04:18.396067 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 264/522] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:18 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:19.419242 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5e654ead-addd-4ec1-83da-75420b03e945 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:19.419937 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5e654ead-addd-4ec1-83da-75420b03e945 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:19.426142 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5e654ead-addd-4ec1-83da-75420b03e945 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:19.426629 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5e654ead-addd-4ec1-83da-75420b03e945 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:19.427063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5e654ead-addd-4ec1-83da-75420b03e945 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:19.427765 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5e654ead-addd-4ec1-83da-75420b03e945 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:19.428221 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5e654ead-addd-4ec1-83da-75420b03e945 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:19.428644 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5e654ead-addd-4ec1-83da-75420b03e945 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:19.432982 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:19.562292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-5e654ead-addd-4ec1-83da-75420b03e945 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:19.570336 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5e654ead-addd-4ec1-83da-75420b03e945 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1506 microversion: 2.1 time: 0.155345 Oct 14 13:04:19.570897 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 259/523] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:19 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:20.593473 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-612faedf-3402-4030-8186-992cfbd30674 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:20.594303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-612faedf-3402-4030-8186-992cfbd30674 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:20.600933 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-612faedf-3402-4030-8186-992cfbd30674 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:20.601416 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-612faedf-3402-4030-8186-992cfbd30674 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:20.601894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-612faedf-3402-4030-8186-992cfbd30674 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:20.602584 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-612faedf-3402-4030-8186-992cfbd30674 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:20.603047 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-612faedf-3402-4030-8186-992cfbd30674 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:20.603474 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-612faedf-3402-4030-8186-992cfbd30674 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:20.840889 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-612faedf-3402-4030-8186-992cfbd30674 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:20.848542 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-612faedf-3402-4030-8186-992cfbd30674 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1506 microversion: 2.1 time: 0.258953 Oct 14 13:04:20.849104 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 265/524] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:20 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:21.044425 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8a9a7e77-0a7a-47ac-9434-bd63dc845984 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88512cf0-2259-410b-9e11-56e152f1c77c"}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:21.047008 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8a9a7e77-0a7a-47ac-9434-bd63dc845984 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:21.053801 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8a9a7e77-0a7a-47ac-9434-bd63dc845984 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:21.054490 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8a9a7e77-0a7a-47ac-9434-bd63dc845984 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:21.054932 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8a9a7e77-0a7a-47ac-9434-bd63dc845984 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:21.055682 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8a9a7e77-0a7a-47ac-9434-bd63dc845984 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:21.056629 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8a9a7e77-0a7a-47ac-9434-bd63dc845984 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:21.057048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8a9a7e77-0a7a-47ac-9434-bd63dc845984 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:21.140012 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-173a6b57-ca49-42e5-9590-3ea89282bac7 req-31ba2092-a4a1-4325-ab36-21b5ac43c620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad463f3e-be3e-40a0-ad61-6eab6a24f957", "name": "network-vif-deleted", "tag": "9a1f9cf5-f6ac-458f-991e-d6fcead5660f"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:21.150928 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-173a6b57-ca49-42e5-9590-3ea89282bac7 req-31ba2092-a4a1-4325-ab36-21b5ac43c620 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:21.151478 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-173a6b57-ca49-42e5-9590-3ea89282bac7 req-31ba2092-a4a1-4325-ab36-21b5ac43c620 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:21.151996 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-173a6b57-ca49-42e5-9590-3ea89282bac7 req-31ba2092-a4a1-4325-ab36-21b5ac43c620 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:21.153623 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-8a9a7e77-0a7a-47ac-9434-bd63dc845984 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] HTTP exception thrown: Invalid volume: volume 88512cf0-2259-410b-9e11-56e152f1c77c is already attached to instances: 083c9d37-dbbe-48e2-9fdf-c23648f93a76 Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8a9a7e77-0a7a-47ac-9434-bd63dc845984 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Request method failure captured: Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: POST /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76/os-volume_attachments HTTP/1.1 Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 74 Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1FViMK-WvBvO8SLI8drD1UcXlTPANFWG-ZTvaw7ModKJdGRWngdLI5cp6n7bXZ7oPe4LkLOonqm901dlPL1Z_CDQlnflfzMT4YPNiiBNZ_K890mBj2sVo-ptm5duO44Ujpzx_OuaK4ZxTnFio58yttRWo_3AshSXsX0p_7cyovml4 Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:04:21.155409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:04:21.156821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c0d083e8cef4333b9514d2256991647", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:04:21.156821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:04:21.156821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:04:21.156821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:04:21.156821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:04:21.156821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:04:21.156821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:04:21.156821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 0bcbf6513b6a4df3b044fadfb7888d54 Oct 14 13:04:21.156821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:04:21.156821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Oct 14 13:04:21.156821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {"volumeAttachment": {"volumeId": "88512cf0-2259-410b-9e11-56e152f1c77c"}} Oct 14 13:04:21.156821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Invalid volume: volume 88512cf0-2259-410b-9e11-56e152f1c77c is already attached to instances: 083c9d37-dbbe-48e2-9fdf-c23648f93a76 Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'server_id': '083c9d37-dbbe-48e2-9fdf-c23648f93a76', 'body': {'volumeAttachment': {'volumeId': '88512cf0-2259-410b-9e11-56e152f1c77c'}}} Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 88512cf0-2259-410b-9e11-56e152f1c77c is already attached to instances: 083c9d37-dbbe-48e2-9fdf-c23648f93a76 Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:04:21.157660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 88512cf0-2259-410b-9e11-56e152f1c77c is already attached to instances: 083c9d37-dbbe-48e2-9fdf-c23648f93a76 Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:04:21.159404 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:04:21.160799 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:04:21.160799 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:04:21.160799 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:04:21.160799 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 88512cf0-2259-410b-9e11-56e152f1c77c is already attached to instances: 083c9d37-dbbe-48e2-9fdf-c23648f93a76 Oct 14 13:04:21.160799 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:04:21.160799 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8a9a7e77-0a7a-47ac-9434-bd63dc845984 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Returning 400 to user: Invalid volume: volume 88512cf0-2259-410b-9e11-56e152f1c77c is already attached to instances: 083c9d37-dbbe-48e2-9fdf-c23648f93a76 {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:04:21.160799 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8a9a7e77-0a7a-47ac-9434-bd63dc845984 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "POST /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117238 Oct 14 13:04:21.160799 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 260/525] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Oct 14 13:04:21 2022] POST /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 14 13:04:21.171101 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-173a6b57-ca49-42e5-9590-3ea89282bac7 req-31ba2092-a4a1-4325-ab36-21b5ac43c620 service nova] Creating event network-vif-deleted:9a1f9cf5-f6ac-458f-991e-d6fcead5660f for instance ad463f3e-be3e-40a0-ad61-6eab6a24f957 on hv-cinder-82099 Oct 14 13:04:21.178923 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-173a6b57-ca49-42e5-9590-3ea89282bac7 req-31ba2092-a4a1-4325-ab36-21b5ac43c620 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042390 Oct 14 13:04:21.180095 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 266/526] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:21.238565 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-846d55f2-bfda-40ef-a7a3-375fb905037a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:21.239114 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-846d55f2-bfda-40ef-a7a3-375fb905037a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:21.245875 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-846d55f2-bfda-40ef-a7a3-375fb905037a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:21.246425 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-846d55f2-bfda-40ef-a7a3-375fb905037a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:21.246868 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-846d55f2-bfda-40ef-a7a3-375fb905037a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:21.247558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-846d55f2-bfda-40ef-a7a3-375fb905037a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:21.248336 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-846d55f2-bfda-40ef-a7a3-375fb905037a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:21.248758 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-846d55f2-bfda-40ef-a7a3-375fb905037a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:21.332715 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-846d55f2-bfda-40ef-a7a3-375fb905037a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lazy-loading 'services' on Instance uuid 083c9d37-dbbe-48e2-9fdf-c23648f93a76 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:04:21.406002 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-846d55f2-bfda-40ef-a7a3-375fb905037a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "DELETE /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76/os-volume_attachments/88512cf0-2259-410b-9e11-56e152f1c77c" status: 202 len: 0 microversion: 2.1 time: 0.172095 Oct 14 13:04:21.406934 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 261/527] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Oct 14 13:04:21 2022] DELETE /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76/os-volume_attachments/88512cf0-2259-410b-9e11-56e152f1c77c => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:04:21.416620 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-eac1c54a-1a73-4c11-8214-d33ae9f47d27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:21.419241 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-eac1c54a-1a73-4c11-8214-d33ae9f47d27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:21.427045 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eac1c54a-1a73-4c11-8214-d33ae9f47d27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:21.427761 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eac1c54a-1a73-4c11-8214-d33ae9f47d27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:21.428196 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eac1c54a-1a73-4c11-8214-d33ae9f47d27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:21.429072 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eac1c54a-1a73-4c11-8214-d33ae9f47d27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:21.429720 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eac1c54a-1a73-4c11-8214-d33ae9f47d27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:21.430148 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eac1c54a-1a73-4c11-8214-d33ae9f47d27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:21.470676 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-eac1c54a-1a73-4c11-8214-d33ae9f47d27 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059198 Oct 14 13:04:21.471374 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 267/528] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:04:21 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:21.873202 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-bcc06c45-4a63-4764-8037-3cf19a7dc42f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:21.873929 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-bcc06c45-4a63-4764-8037-3cf19a7dc42f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:21.880099 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bcc06c45-4a63-4764-8037-3cf19a7dc42f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:21.880578 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bcc06c45-4a63-4764-8037-3cf19a7dc42f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:21.881012 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bcc06c45-4a63-4764-8037-3cf19a7dc42f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:21.881734 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bcc06c45-4a63-4764-8037-3cf19a7dc42f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:21.882188 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bcc06c45-4a63-4764-8037-3cf19a7dc42f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:21.882607 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bcc06c45-4a63-4764-8037-3cf19a7dc42f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:21.912916 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bcc06c45-4a63-4764-8037-3cf19a7dc42f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:21.913394 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bcc06c45-4a63-4764-8037-3cf19a7dc42f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:21.913865 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bcc06c45-4a63-4764-8037-3cf19a7dc42f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:21.914304 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-bcc06c45-4a63-4764-8037-3cf19a7dc42f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lazy-loading 'fault' on Instance uuid ad463f3e-be3e-40a0-ad61-6eab6a24f957 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:04:21.954926 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-bcc06c45-4a63-4764-8037-3cf19a7dc42f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:21.962489 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-bcc06c45-4a63-4764-8037-3cf19a7dc42f tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 200 len: 1311 microversion: 2.1 time: 0.094220 Oct 14 13:04:21.963042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 262/529] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:21 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:22.483566 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7a8e6b4a-4ed5-47d1-9931-88bb0f8d3684 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:22.485955 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-7a8e6b4a-4ed5-47d1-9931-88bb0f8d3684 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:22.492360 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7a8e6b4a-4ed5-47d1-9931-88bb0f8d3684 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:22.492844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7a8e6b4a-4ed5-47d1-9931-88bb0f8d3684 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:22.493346 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7a8e6b4a-4ed5-47d1-9931-88bb0f8d3684 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:22.494165 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7a8e6b4a-4ed5-47d1-9931-88bb0f8d3684 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:22.494622 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7a8e6b4a-4ed5-47d1-9931-88bb0f8d3684 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:22.495049 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7a8e6b4a-4ed5-47d1-9931-88bb0f8d3684 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:22.523569 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7a8e6b4a-4ed5-47d1-9931-88bb0f8d3684 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044129 Oct 14 13:04:22.524117 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 268/530] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:04:22 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 13:04:22.586100 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0327c1f5-2af7-4141-878a-3a33a2ff20db tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:22.586581 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-0327c1f5-2af7-4141-878a-3a33a2ff20db tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:22.593090 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0327c1f5-2af7-4141-878a-3a33a2ff20db tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:22.593600 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0327c1f5-2af7-4141-878a-3a33a2ff20db tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:22.594032 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0327c1f5-2af7-4141-878a-3a33a2ff20db tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:22.594716 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0327c1f5-2af7-4141-878a-3a33a2ff20db tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:22.595256 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0327c1f5-2af7-4141-878a-3a33a2ff20db tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:22.595682 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0327c1f5-2af7-4141-878a-3a33a2ff20db tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:22.621707 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-0327c1f5-2af7-4141-878a-3a33a2ff20db tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Going to try to terminate instance {{(pid=118869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:04:22.694933 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-0327c1f5-2af7-4141-878a-3a33a2ff20db tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "DELETE /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 204 len: 0 microversion: 2.1 time: 0.112581 Oct 14 13:04:22.695878 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 263/531] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:04:22 2022] DELETE /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:04:22.705687 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f1024d50-2436-4c7c-81fb-4166db0fac64 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:22.706559 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-f1024d50-2436-4c7c-81fb-4166db0fac64 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:22.713302 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f1024d50-2436-4c7c-81fb-4166db0fac64 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:22.713850 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f1024d50-2436-4c7c-81fb-4166db0fac64 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:22.714294 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f1024d50-2436-4c7c-81fb-4166db0fac64 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:22.714991 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f1024d50-2436-4c7c-81fb-4166db0fac64 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:22.715483 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f1024d50-2436-4c7c-81fb-4166db0fac64 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:22.715911 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f1024d50-2436-4c7c-81fb-4166db0fac64 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:22.845957 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f1024d50-2436-4c7c-81fb-4166db0fac64 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:22.853982 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f1024d50-2436-4c7c-81fb-4166db0fac64 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1681 microversion: 2.1 time: 0.153270 Oct 14 13:04:22.854545 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 269/532] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:22 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:22.986612 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-481db960-fc4a-44a6-b0b3-2c21d56d48e4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:22.987311 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-481db960-fc4a-44a6-b0b3-2c21d56d48e4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: ad463f3e-be3e-40a0-ad61-6eab6a24f957] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:22.993876 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-481db960-fc4a-44a6-b0b3-2c21d56d48e4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:22.994356 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-481db960-fc4a-44a6-b0b3-2c21d56d48e4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:22.994821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-481db960-fc4a-44a6-b0b3-2c21d56d48e4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:22.995507 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-481db960-fc4a-44a6-b0b3-2c21d56d48e4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:22.995955 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-481db960-fc4a-44a6-b0b3-2c21d56d48e4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:22.996376 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-481db960-fc4a-44a6-b0b3-2c21d56d48e4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:23.009710 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-481db960-fc4a-44a6-b0b3-2c21d56d48e4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] HTTP exception thrown: Instance ad463f3e-be3e-40a0-ad61-6eab6a24f957 could not be found. Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-481db960-fc4a-44a6-b0b3-2c21d56d48e4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Request method failure captured: Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 HTTP/1.1 Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1Cs09Cu8vSps46z6W6PeSQaPlaz7RbycBpbAaKGyNLkJbBPIE899Agnc8xKbSQMAp8rE7tSu7AwxUpIowQS4vJkiL31SuEvGTrM_qnAchngAi6kRbyLURlB3MBaW58J1FeYinNbeUIsTaDmwhcpSEQThHsj_MktdqLjb4gv2tw8pQ Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: c160176d8c804b7793bae21c205c538c Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-284328419 Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:04:23.011300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:04:23.012863 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c160176d8c804b7793bae21c205c538c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c160176d8c804b7793bae21c205c538c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c160176d8c804b7793bae21c205c538c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c160176d8c804b7793bae21c205c538c", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:04:23.012863 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-ServerRescueNegativeTestJSON-284328419 Oct 14 13:04:23.012863 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: c160176d8c804b7793bae21c205c538c Oct 14 13:04:23.012863 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-284328419 Oct 14 13:04:23.012863 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-ServerRescueNegativeTestJSON-284328419-project Oct 14 13:04:23.012863 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:04:23.012863 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:04:23.012863 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 60860294eb284b8aa11edd42dca4ae8d Oct 14 13:04:23.012863 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-ServerRescueNegativeTestJSON-284328419-project Oct 14 13:04:23.012863 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:04:23.012863 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance ad463f3e-be3e-40a0-ad61-6eab6a24f957 could not be found. Oct 14 13:04:23.012863 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': 'ad463f3e-be3e-40a0-ad61-6eab6a24f957'} Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad463f3e-be3e-40a0-ad61-6eab6a24f957 could not be found. Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:04:23.013954 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad463f3e-be3e-40a0-ad61-6eab6a24f957 could not be found. Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad463f3e-be3e-40a0-ad61-6eab6a24f957 could not be found. Oct 14 13:04:23.015386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:04:23.016957 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-481db960-fc4a-44a6-b0b3-2c21d56d48e4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Returning 404 to user: Instance ad463f3e-be3e-40a0-ad61-6eab6a24f957 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:04:23.016957 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-481db960-fc4a-44a6-b0b3-2c21d56d48e4 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957" status: 404 len: 111 microversion: 2.1 time: 0.030508 Oct 14 13:04:23.016957 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 264/533] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:22 2022] GET /compute/v2.1/servers/ad463f3e-be3e-40a0-ad61-6eab6a24f957 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 13:04:23.021695 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9acc4c59-2667-4941-a015-5cd733fd4c34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:23.022195 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-9acc4c59-2667-4941-a015-5cd733fd4c34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:23.028222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9acc4c59-2667-4941-a015-5cd733fd4c34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:23.028707 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9acc4c59-2667-4941-a015-5cd733fd4c34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:23.029146 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9acc4c59-2667-4941-a015-5cd733fd4c34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:23.029886 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9acc4c59-2667-4941-a015-5cd733fd4c34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:23.030362 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9acc4c59-2667-4941-a015-5cd733fd4c34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:23.030774 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9acc4c59-2667-4941-a015-5cd733fd4c34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:23.056557 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-9acc4c59-2667-4941-a015-5cd733fd4c34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Going to try to terminate instance {{(pid=118868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:04:23.128640 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-9acc4c59-2667-4941-a015-5cd733fd4c34 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "DELETE /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 204 len: 0 microversion: 2.1 time: 0.110560 Oct 14 13:04:23.129216 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 270/534] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:04:23 2022] DELETE /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 14 13:04:23.137292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-74005d7e-5b27-4ace-affd-2d009848155a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:23.137940 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-74005d7e-5b27-4ace-affd-2d009848155a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:23.143789 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-74005d7e-5b27-4ace-affd-2d009848155a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:23.144272 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-74005d7e-5b27-4ace-affd-2d009848155a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:23.144709 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-74005d7e-5b27-4ace-affd-2d009848155a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:23.145400 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-74005d7e-5b27-4ace-affd-2d009848155a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:23.145876 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-74005d7e-5b27-4ace-affd-2d009848155a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:23.146307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-74005d7e-5b27-4ace-affd-2d009848155a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:23.273977 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-74005d7e-5b27-4ace-affd-2d009848155a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:23.282168 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-74005d7e-5b27-4ace-affd-2d009848155a tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.148782 Oct 14 13:04:23.282720 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 265/535] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:23 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:23.878239 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-8a4cfa36-d8ba-4620-a317-4c89d3f0ea1f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:23.878967 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-8a4cfa36-d8ba-4620-a317-4c89d3f0ea1f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:23.887056 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8a4cfa36-d8ba-4620-a317-4c89d3f0ea1f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:23.887538 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8a4cfa36-d8ba-4620-a317-4c89d3f0ea1f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:23.887972 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8a4cfa36-d8ba-4620-a317-4c89d3f0ea1f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:23.888644 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8a4cfa36-d8ba-4620-a317-4c89d3f0ea1f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:23.889094 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8a4cfa36-d8ba-4620-a317-4c89d3f0ea1f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:23.889538 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8a4cfa36-d8ba-4620-a317-4c89d3f0ea1f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:24.022216 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-8a4cfa36-d8ba-4620-a317-4c89d3f0ea1f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:24.031020 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-8a4cfa36-d8ba-4620-a317-4c89d3f0ea1f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1681 microversion: 2.1 time: 0.156995 Oct 14 13:04:24.031585 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 271/536] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:23 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:24.305761 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7cd9ed02-5cf1-4ac5-8436-7a61ee1cea5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:24.306813 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7cd9ed02-5cf1-4ac5-8436-7a61ee1cea5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:24.312734 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7cd9ed02-5cf1-4ac5-8436-7a61ee1cea5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:24.313215 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7cd9ed02-5cf1-4ac5-8436-7a61ee1cea5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:24.313686 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7cd9ed02-5cf1-4ac5-8436-7a61ee1cea5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:24.314374 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7cd9ed02-5cf1-4ac5-8436-7a61ee1cea5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:24.314825 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7cd9ed02-5cf1-4ac5-8436-7a61ee1cea5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:24.315247 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7cd9ed02-5cf1-4ac5-8436-7a61ee1cea5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:24.449118 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7cd9ed02-5cf1-4ac5-8436-7a61ee1cea5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:24.456888 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7cd9ed02-5cf1-4ac5-8436-7a61ee1cea5d tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.155142 Oct 14 13:04:24.457433 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 266/537] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:24 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:04:25.053979 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-83c6cca5-8f1d-448b-9cba-1df123f0a049 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:25.054708 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-83c6cca5-8f1d-448b-9cba-1df123f0a049 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:25.061069 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-83c6cca5-8f1d-448b-9cba-1df123f0a049 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:25.061581 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-83c6cca5-8f1d-448b-9cba-1df123f0a049 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:25.062020 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-83c6cca5-8f1d-448b-9cba-1df123f0a049 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:25.062696 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-83c6cca5-8f1d-448b-9cba-1df123f0a049 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:25.063145 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-83c6cca5-8f1d-448b-9cba-1df123f0a049 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:25.063663 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-83c6cca5-8f1d-448b-9cba-1df123f0a049 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:25.192765 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-83c6cca5-8f1d-448b-9cba-1df123f0a049 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:25.201304 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-83c6cca5-8f1d-448b-9cba-1df123f0a049 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1681 microversion: 2.1 time: 0.150883 Oct 14 13:04:25.201890 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 272/538] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:25 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:25.479320 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-12f5c852-3874-4c83-a239-96ae4c8af3ca tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:25.479932 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-12f5c852-3874-4c83-a239-96ae4c8af3ca tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:25.486182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12f5c852-3874-4c83-a239-96ae4c8af3ca tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:25.486669 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12f5c852-3874-4c83-a239-96ae4c8af3ca tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:25.487138 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12f5c852-3874-4c83-a239-96ae4c8af3ca tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:25.487828 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12f5c852-3874-4c83-a239-96ae4c8af3ca tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:25.488281 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12f5c852-3874-4c83-a239-96ae4c8af3ca tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:25.488715 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12f5c852-3874-4c83-a239-96ae4c8af3ca tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:25.614819 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-12f5c852-3874-4c83-a239-96ae4c8af3ca tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:25.622502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-12f5c852-3874-4c83-a239-96ae4c8af3ca tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.147618 Oct 14 13:04:25.623063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 267/539] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:25 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:26.225080 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-43d9afd0-4512-432c-bec2-03ba5d7466aa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:26.225687 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-43d9afd0-4512-432c-bec2-03ba5d7466aa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:26.232430 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-43d9afd0-4512-432c-bec2-03ba5d7466aa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:26.232908 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-43d9afd0-4512-432c-bec2-03ba5d7466aa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:26.233334 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-43d9afd0-4512-432c-bec2-03ba5d7466aa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:26.234040 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-43d9afd0-4512-432c-bec2-03ba5d7466aa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:26.234486 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-43d9afd0-4512-432c-bec2-03ba5d7466aa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:26.235353 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-43d9afd0-4512-432c-bec2-03ba5d7466aa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:26.364858 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-43d9afd0-4512-432c-bec2-03ba5d7466aa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:26.372601 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-43d9afd0-4512-432c-bec2-03ba5d7466aa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1681 microversion: 2.1 time: 0.151434 Oct 14 13:04:26.373171 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 273/540] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:26 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:26.644891 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-43b02255-a60d-4b69-895c-b00331803c5b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:26.645519 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-43b02255-a60d-4b69-895c-b00331803c5b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:26.652075 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-43b02255-a60d-4b69-895c-b00331803c5b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:26.652553 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-43b02255-a60d-4b69-895c-b00331803c5b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:26.652987 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-43b02255-a60d-4b69-895c-b00331803c5b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:26.653696 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-43b02255-a60d-4b69-895c-b00331803c5b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:26.654148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-43b02255-a60d-4b69-895c-b00331803c5b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:26.654570 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-43b02255-a60d-4b69-895c-b00331803c5b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:26.782155 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-43b02255-a60d-4b69-895c-b00331803c5b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:26.790091 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-43b02255-a60d-4b69-895c-b00331803c5b tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.148781 Oct 14 13:04:26.791317 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 268/541] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:26 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:27.395559 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-74576081-8dd9-4f02-bc02-a4082d161057 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:27.396168 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-74576081-8dd9-4f02-bc02-a4082d161057 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:27.402474 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-74576081-8dd9-4f02-bc02-a4082d161057 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:27.402956 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-74576081-8dd9-4f02-bc02-a4082d161057 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:27.403515 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-74576081-8dd9-4f02-bc02-a4082d161057 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:27.404204 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-74576081-8dd9-4f02-bc02-a4082d161057 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:27.404649 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-74576081-8dd9-4f02-bc02-a4082d161057 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:27.405068 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-74576081-8dd9-4f02-bc02-a4082d161057 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:27.767339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-74576081-8dd9-4f02-bc02-a4082d161057 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:27.775590 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-74576081-8dd9-4f02-bc02-a4082d161057 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1681 microversion: 2.1 time: 0.383383 Oct 14 13:04:27.776364 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 274/542] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:27 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1681 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:27.812123 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-06e4c5bc-b1d6-4474-84dc-a007bc27e227 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:27.812730 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-06e4c5bc-b1d6-4474-84dc-a007bc27e227 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:27.818679 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06e4c5bc-b1d6-4474-84dc-a007bc27e227 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:27.819171 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06e4c5bc-b1d6-4474-84dc-a007bc27e227 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:27.819605 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06e4c5bc-b1d6-4474-84dc-a007bc27e227 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:27.820325 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06e4c5bc-b1d6-4474-84dc-a007bc27e227 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:27.820777 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06e4c5bc-b1d6-4474-84dc-a007bc27e227 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:27.821197 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-06e4c5bc-b1d6-4474-84dc-a007bc27e227 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:27.952785 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-06e4c5bc-b1d6-4474-84dc-a007bc27e227 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60860294eb284b8aa11edd42dca4ae8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c160176d8c804b7793bae21c205c538c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:27.960529 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-06e4c5bc-b1d6-4474-84dc-a007bc27e227 tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 200 len: 1521 microversion: 2.1 time: 0.152261 Oct 14 13:04:27.961080 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 269/543] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:27 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:28.292795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-a3bb042f-5a28-48c8-8dfe-b5f6420ef69b req-72c8851d-9612-4657-a639-5d9485ae3d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20015651-8ebe-44d9-9d4a-b4e15741c295", "name": "network-vif-deleted", "tag": "4749694d-66d5-4de8-b827-176ffeb49aa3"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:28.303593 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-a3bb042f-5a28-48c8-8dfe-b5f6420ef69b req-72c8851d-9612-4657-a639-5d9485ae3d3a service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:28.304175 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-a3bb042f-5a28-48c8-8dfe-b5f6420ef69b req-72c8851d-9612-4657-a639-5d9485ae3d3a service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:28.304700 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-a3bb042f-5a28-48c8-8dfe-b5f6420ef69b req-72c8851d-9612-4657-a639-5d9485ae3d3a service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:28.318494 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-a3bb042f-5a28-48c8-8dfe-b5f6420ef69b req-72c8851d-9612-4657-a639-5d9485ae3d3a service nova] Creating event network-vif-deleted:4749694d-66d5-4de8-b827-176ffeb49aa3 for instance 20015651-8ebe-44d9-9d4a-b4e15741c295 on hv-cinder-82099 Oct 14 13:04:28.324330 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-a3bb042f-5a28-48c8-8dfe-b5f6420ef69b req-72c8851d-9612-4657-a639-5d9485ae3d3a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035178 Oct 14 13:04:28.324925 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 275/544] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:28.800013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-00658301-03e6-41d4-b212-8486e2ca6096 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:28.801005 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-00658301-03e6-41d4-b212-8486e2ca6096 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:28.808037 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00658301-03e6-41d4-b212-8486e2ca6096 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:28.808674 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00658301-03e6-41d4-b212-8486e2ca6096 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:28.809206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00658301-03e6-41d4-b212-8486e2ca6096 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:28.810670 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00658301-03e6-41d4-b212-8486e2ca6096 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:28.811326 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00658301-03e6-41d4-b212-8486e2ca6096 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:28.811951 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00658301-03e6-41d4-b212-8486e2ca6096 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:28.897086 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-00658301-03e6-41d4-b212-8486e2ca6096 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:28.907000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-00658301-03e6-41d4-b212-8486e2ca6096 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 200 len: 1613 microversion: 2.1 time: 0.111326 Oct 14 13:04:28.907893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 270/545] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:28 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 1613 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:28.988179 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-fc58dfdf-cf58-42c2-811a-2e22bba7efdb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:28.988969 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-fc58dfdf-cf58-42c2-811a-2e22bba7efdb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] [instance: 20015651-8ebe-44d9-9d4a-b4e15741c295] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:28.995759 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fc58dfdf-cf58-42c2-811a-2e22bba7efdb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:28.996675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fc58dfdf-cf58-42c2-811a-2e22bba7efdb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:28.997127 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fc58dfdf-cf58-42c2-811a-2e22bba7efdb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:28.997862 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fc58dfdf-cf58-42c2-811a-2e22bba7efdb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:28.998506 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fc58dfdf-cf58-42c2-811a-2e22bba7efdb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:28.998936 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fc58dfdf-cf58-42c2-811a-2e22bba7efdb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:29.015845 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-fc58dfdf-cf58-42c2-811a-2e22bba7efdb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] HTTP exception thrown: Instance 20015651-8ebe-44d9-9d4a-b4e15741c295 could not be found. Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-fc58dfdf-cf58-42c2-811a-2e22bba7efdb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Request method failure captured: Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 HTTP/1.1 Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV1Cs09Cu8vSps46z6W6PeSQaPlaz7RbycBpbAaKGyNLkJbBPIE899Agnc8xKbSQMAp8rE7tSu7AwxUpIowQS4vJkiL31SuEvGTrM_qnAchngAi6kRbyLURlB3MBaW58J1FeYinNbeUIsTaDmwhcpSEQThHsj_MktdqLjb4gv2tw8pQ Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: c160176d8c804b7793bae21c205c538c Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-284328419 Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:04:29.017536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:04:29.019105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c160176d8c804b7793bae21c205c538c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/c160176d8c804b7793bae21c205c538c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/c160176d8c804b7793bae21c205c538c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_c160176d8c804b7793bae21c205c538c", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:04:29.019105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-ServerRescueNegativeTestJSON-284328419 Oct 14 13:04:29.019105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: c160176d8c804b7793bae21c205c538c Oct 14 13:04:29.019105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-284328419 Oct 14 13:04:29.019105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-ServerRescueNegativeTestJSON-284328419-project Oct 14 13:04:29.019105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:04:29.019105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:04:29.019105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 60860294eb284b8aa11edd42dca4ae8d Oct 14 13:04:29.019105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-ServerRescueNegativeTestJSON-284328419-project Oct 14 13:04:29.019105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:04:29.019105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance 20015651-8ebe-44d9-9d4a-b4e15741c295 could not be found. Oct 14 13:04:29.019105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '20015651-8ebe-44d9-9d4a-b4e15741c295'} Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20015651-8ebe-44d9-9d4a-b4e15741c295 could not be found. Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:04:29.020033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20015651-8ebe-44d9-9d4a-b4e15741c295 could not be found. Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20015651-8ebe-44d9-9d4a-b4e15741c295 could not be found. Oct 14 13:04:29.021517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:04:29.022714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-fc58dfdf-cf58-42c2-811a-2e22bba7efdb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] Returning 404 to user: Instance 20015651-8ebe-44d9-9d4a-b4e15741c295 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:04:29.022714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-fc58dfdf-cf58-42c2-811a-2e22bba7efdb tempest-ServerRescueNegativeTestJSON-284328419 tempest-ServerRescueNegativeTestJSON-284328419-project] 10.222.0.47 "GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295" status: 404 len: 111 microversion: 2.1 time: 0.037918 Oct 14 13:04:29.022714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 276/546] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:28 2022] GET /compute/v2.1/servers/20015651-8ebe-44d9-9d4a-b4e15741c295 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:04:29.932693 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c6b47953-0543-43b5-8bf2-1f1868132b98 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:29.933307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c6b47953-0543-43b5-8bf2-1f1868132b98 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:29.939319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c6b47953-0543-43b5-8bf2-1f1868132b98 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:29.940102 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c6b47953-0543-43b5-8bf2-1f1868132b98 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:29.940232 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c6b47953-0543-43b5-8bf2-1f1868132b98 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:29.940926 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c6b47953-0543-43b5-8bf2-1f1868132b98 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:29.941375 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c6b47953-0543-43b5-8bf2-1f1868132b98 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:29.941826 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c6b47953-0543-43b5-8bf2-1f1868132b98 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:29.955340 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-c6b47953-0543-43b5-8bf2-1f1868132b98 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] HTTP exception thrown: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c6b47953-0543-43b5-8bf2-1f1868132b98 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Request method failure captured: Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 HTTP/1.1 Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1FViMK-WvBvO8SLI8drD1UcXlTPANFWG-ZTvaw7ModKJdGRWngdLI5cp6n7bXZ7oPe4LkLOonqm901dlPL1Z_CDQlnflfzMT4YPNiiBNZ_K890mBj2sVo-ptm5duO44Ujpzx_OuaK4ZxTnFio58yttRWo_3AshSXsX0p_7cyovml4 Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:04:29.956892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:04:29.958517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c0d083e8cef4333b9514d2256991647", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:04:29.958517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:04:29.958517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:04:29.958517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:04:29.958517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:04:29.958517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:04:29.958517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:04:29.958517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 0bcbf6513b6a4df3b044fadfb7888d54 Oct 14 13:04:29.958517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:04:29.958517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:04:29.958517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. Oct 14 13:04:29.958517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '083c9d37-dbbe-48e2-9fdf-c23648f93a76'} Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:04:29.959407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. Oct 14 13:04:29.964238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:04:29.965619 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c6b47953-0543-43b5-8bf2-1f1868132b98 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Returning 404 to user: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:04:29.965619 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c6b47953-0543-43b5-8bf2-1f1868132b98 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 404 len: 111 microversion: 2.1 time: 0.031416 Oct 14 13:04:29.965619 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 271/547] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:29 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:04:29.971005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-35b4a4a0-eea6-4c43-97c3-75a69efb88f7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '.version_select at 0x7fbb81abb4c0>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:30.000927 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-35b4a4a0-eea6-4c43-97c3-75a69efb88f7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-785556372" status: 202 len: 0 microversion: 2.1 time: 0.033748 Oct 14 13:04:30.001587 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 277/548] 10.222.0.47 () {58 vars in 1218 bytes} [Fri Oct 14 13:04:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-785556372 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:04:30.349866 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-c7217937-1c90-45f8-b8f3-d28ceaa95b62 req-d0c3ebb6-ecca-4f22-932a-ccb7a0d8fa0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083c9d37-dbbe-48e2-9fdf-c23648f93a76", "name": "network-vif-deleted", "tag": "a2f37eab-d8a1-4f80-9b48-0dc66a773d6f"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:30.361831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-c7217937-1c90-45f8-b8f3-d28ceaa95b62 req-d0c3ebb6-ecca-4f22-932a-ccb7a0d8fa0f service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:30.362510 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-c7217937-1c90-45f8-b8f3-d28ceaa95b62 req-d0c3ebb6-ecca-4f22-932a-ccb7a0d8fa0f service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:30.363254 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-c7217937-1c90-45f8-b8f3-d28ceaa95b62 req-d0c3ebb6-ecca-4f22-932a-ccb7a0d8fa0f service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:30.381215 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-c7217937-1c90-45f8-b8f3-d28ceaa95b62 req-d0c3ebb6-ecca-4f22-932a-ccb7a0d8fa0f service nova] Creating event network-vif-deleted:a2f37eab-d8a1-4f80-9b48-0dc66a773d6f for instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 on hv-cinder-82099 Oct 14 13:04:30.388042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-c7217937-1c90-45f8-b8f3-d28ceaa95b62 req-d0c3ebb6-ecca-4f22-932a-ccb7a0d8fa0f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040899 Oct 14 13:04:30.389009 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 272/549] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:30.654443 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e3604c46-a366-4d9b-b2bc-e6dd2e4bacf4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Action: 'create', calling method: .version_select at 0x7fbb81aa2310>, body: {"keypair": {"name": "tempest-keypair-601436065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJsj/vKMAFdtdu16MWnYMUqCo447WlR0buEvuHv+6BuMfyR5VIhDVPLV6sampvjQzxEhH4iHheMXgOFa0ln1d/AZp0jivDib4ZGCxGYK6ad3BY/SShmpA6mFGNGF+gGeg=="}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:30.671192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-e3604c46-a366-4d9b-b2bc-e6dd2e4bacf4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for project 6c0d083e8cef4333b9514d2256991647. Resources: {'key_pairs'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:04:30.675125 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-e3604c46-a366-4d9b-b2bc-e6dd2e4bacf4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for user 0bcbf6513b6a4df3b044fadfb7888d54 and project 6c0d083e8cef4333b9514d2256991647. Resources: {'key_pairs'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:04:30.698926 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e3604c46-a366-4d9b-b2bc-e6dd2e4bacf4 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049098 Oct 14 13:04:30.699863 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 278/550] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Oct 14 13:04:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:32.530027 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1680814824", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "70bca7d9-a052-4048-8e74-16b14b95c03e"}], "security_groups": [{"name": "tempest-securitygroup--2024652649"}], "key_name": "tempest-keypair-601436065", "user_data": "}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:32.642453 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.network.neutron [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] validate_networks() for [('70bca7d9-a052-4048-8e74-16b14b95c03e', None, None, None, None, None)] {{(pid=118869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:04:33.147087 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Flavor limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:04:33.147509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Image limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:04:33.147985 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Flavor pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:04:33.148389 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Image pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:04:33.148947 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:04:33.161769 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:33.162265 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:33.162698 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:33.163432 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:33.163884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:33.164310 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:33.187149 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for project 6c0d083e8cef4333b9514d2256991647. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:04:33.191355 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Getting quotas for user 0bcbf6513b6a4df3b044fadfb7888d54 and project 6c0d083e8cef4333b9514d2256991647. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:04:33.202698 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Going to run 1 instances... {{(pid=118869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:04:33.205514 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:04:33.255302 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-d4d79f21-619c-42a8-99d1-3fa36a3d7d43 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.730664 Oct 14 13:04:33.257527 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 273/551] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:04:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 13:04:33.267799 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5ed0e9be-d29e-4cec-88e6-8d578e8e1937 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:33.268409 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5ed0e9be-d29e-4cec-88e6-8d578e8e1937 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:33.350517 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5ed0e9be-d29e-4cec-88e6-8d578e8e1937 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:33.358304 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5ed0e9be-d29e-4cec-88e6-8d578e8e1937 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 200 len: 1241 microversion: 2.1 time: 0.094815 Oct 14 13:04:33.358875 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 279/552] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:33 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:34.382512 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-44605657-f2af-46c3-b9b0-61f6426e7827 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:34.383442 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-44605657-f2af-46c3-b9b0-61f6426e7827 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:34.390610 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-44605657-f2af-46c3-b9b0-61f6426e7827 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:34.391578 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-44605657-f2af-46c3-b9b0-61f6426e7827 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:34.392236 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-44605657-f2af-46c3-b9b0-61f6426e7827 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:34.393013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-44605657-f2af-46c3-b9b0-61f6426e7827 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:34.393458 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-44605657-f2af-46c3-b9b0-61f6426e7827 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:34.394356 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-44605657-f2af-46c3-b9b0-61f6426e7827 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:34.468283 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-44605657-f2af-46c3-b9b0-61f6426e7827 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:34.492052 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-44605657-f2af-46c3-b9b0-61f6426e7827 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 200 len: 1301 microversion: 2.1 time: 0.114117 Oct 14 13:04:34.492626 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 274/553] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:34 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 1301 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:35.519446 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-820e5cb4-b99e-46ba-b9d6-48f09406fb79 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:35.519999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-820e5cb4-b99e-46ba-b9d6-48f09406fb79 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:35.527092 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-820e5cb4-b99e-46ba-b9d6-48f09406fb79 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:35.527584 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-820e5cb4-b99e-46ba-b9d6-48f09406fb79 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:35.528012 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-820e5cb4-b99e-46ba-b9d6-48f09406fb79 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:35.528704 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-820e5cb4-b99e-46ba-b9d6-48f09406fb79 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:35.529148 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-820e5cb4-b99e-46ba-b9d6-48f09406fb79 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:35.529633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-820e5cb4-b99e-46ba-b9d6-48f09406fb79 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:35.610255 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a042a73a-083f-478c-9aee-74c1f3cc7d39 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] Calling method '.version_select at 0x7fbb81a870d0>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:35.661643 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-a042a73a-083f-478c-9aee-74c1f3cc7d39 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/c3487cb5-3074-4af5-b20c-9d5be605fc2a" status: 200 len: 350 microversion: 2.1 time: 0.055446 Oct 14 13:04:35.662205 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 275/554] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Oct 14 13:04:35 2022] GET /compute/v2.1/os-volumes/c3487cb5-3074-4af5-b20c-9d5be605fc2a => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:04:36.074424 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-820e5cb4-b99e-46ba-b9d6-48f09406fb79 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:36.082056 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-820e5cb4-b99e-46ba-b9d6-48f09406fb79 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 200 len: 1367 microversion: 2.1 time: 0.566706 Oct 14 13:04:36.082629 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 280/555] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:35 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 1367 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:36.183399 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-8d2e215a-8e6c-4848-9347-d05194704e75 req-4952edfd-9cb1-4a44-98ac-af6b4f02eb40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a62f4f4-9e85-4d89-9580-445a0369cadc", "tag": "5d64d93f-8984-45dd-b22b-857d5d14a329"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:36.193422 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-8d2e215a-8e6c-4848-9347-d05194704e75 req-4952edfd-9cb1-4a44-98ac-af6b4f02eb40 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:36.193945 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-8d2e215a-8e6c-4848-9347-d05194704e75 req-4952edfd-9cb1-4a44-98ac-af6b4f02eb40 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:36.194372 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-8d2e215a-8e6c-4848-9347-d05194704e75 req-4952edfd-9cb1-4a44-98ac-af6b4f02eb40 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:36.207102 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-8d2e215a-8e6c-4848-9347-d05194704e75 req-4952edfd-9cb1-4a44-98ac-af6b4f02eb40 service nova] Creating event network-changed:5d64d93f-8984-45dd-b22b-857d5d14a329 for instance 5a62f4f4-9e85-4d89-9580-445a0369cadc on hv-cinder-82099 Oct 14 13:04:36.212830 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-8d2e215a-8e6c-4848-9347-d05194704e75 req-4952edfd-9cb1-4a44-98ac-af6b4f02eb40 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033157 Oct 14 13:04:36.213447 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 276/556] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:37.035895 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6e6c9619-f23a-44c0-83d3-83e789651e0e tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] Calling method '.version_select at 0x7fbb81feea60>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:37.082618 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-6e6c9619-f23a-44c0-83d3-83e789651e0e tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e1a73d3e-80c1-4ada-88d6-7945e8739966" status: 200 len: 350 microversion: 2.1 time: 0.050478 Oct 14 13:04:37.083185 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 281/557] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Oct 14 13:04:37 2022] GET /compute/v2.1/os-volumes/e1a73d3e-80c1-4ada-88d6-7945e8739966 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:37.104975 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-34940a8b-0af5-49a7-8ad2-d6bbbaa286de tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:37.105755 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-34940a8b-0af5-49a7-8ad2-d6bbbaa286de tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:37.112054 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34940a8b-0af5-49a7-8ad2-d6bbbaa286de tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:37.112535 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34940a8b-0af5-49a7-8ad2-d6bbbaa286de tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:37.112972 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34940a8b-0af5-49a7-8ad2-d6bbbaa286de tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:37.113701 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34940a8b-0af5-49a7-8ad2-d6bbbaa286de tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:37.114154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34940a8b-0af5-49a7-8ad2-d6bbbaa286de tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:37.114578 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34940a8b-0af5-49a7-8ad2-d6bbbaa286de tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:37.132474 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:37.252624 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-34940a8b-0af5-49a7-8ad2-d6bbbaa286de tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:37.260786 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-34940a8b-0af5-49a7-8ad2-d6bbbaa286de tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 200 len: 1367 microversion: 2.1 time: 0.160508 Oct 14 13:04:37.263040 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 277/558] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:37 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:38.285177 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e900344b-01fb-4f68-bbf0-34673a86de39 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:38.285831 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e900344b-01fb-4f68-bbf0-34673a86de39 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:38.287775 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:38.293721 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e900344b-01fb-4f68-bbf0-34673a86de39 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:38.294209 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e900344b-01fb-4f68-bbf0-34673a86de39 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:38.294644 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e900344b-01fb-4f68-bbf0-34673a86de39 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:38.295332 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e900344b-01fb-4f68-bbf0-34673a86de39 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:38.295784 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e900344b-01fb-4f68-bbf0-34673a86de39 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:38.296209 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e900344b-01fb-4f68-bbf0-34673a86de39 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:38.422311 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-3204e4f6-5eda-4f80-aae3-263b241b85e8 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] Calling method '.version_select at 0x7fbb81a874c0>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:38.432557 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e900344b-01fb-4f68-bbf0-34673a86de39 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:38.440157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e900344b-01fb-4f68-bbf0-34673a86de39 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 200 len: 1367 microversion: 2.1 time: 0.159510 Oct 14 13:04:38.440724 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 282/559] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:38 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:38.469406 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-3204e4f6-5eda-4f80-aae3-263b241b85e8 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/e43ee574-524b-4b6a-a899-e8641ca0e00b" status: 200 len: 350 microversion: 2.1 time: 0.050811 Oct 14 13:04:38.470003 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 278/560] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Oct 14 13:04:38 2022] GET /compute/v2.1/os-volumes/e43ee574-524b-4b6a-a899-e8641ca0e00b => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:04:38.482558 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-fbb488ab-af0e-48a8-aeb0-205524b60cc3 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] Calling method '.version_select at 0x7fbb81aa21f0>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:38.563591 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-fbb488ab-af0e-48a8-aeb0-205524b60cc3 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.084622 Oct 14 13:04:38.564155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 283/561] 10.222.0.47 () {58 vars in 1134 bytes} [Fri Oct 14 13:04:38 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:38.579084 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-41dc8f8c-7a72-42c0-9bec-4028ff81c479 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] Calling method '.version_select at 0x7fbb81c14280>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:38.658704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-41dc8f8c-7a72-42c0-9bec-4028ff81c479 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.083480 Oct 14 13:04:38.659262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 279/562] 10.222.0.47 () {58 vars in 1149 bytes} [Fri Oct 14 13:04:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:38.673111 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7d93ee90-6508-4fb4-859e-9ff17b338405 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] Calling method '.version_select at 0x7fbb81a73040>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:38.753236 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7d93ee90-6508-4fb4-859e-9ff17b338405 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.083736 Oct 14 13:04:38.753855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 284/563] 10.222.0.47 () {58 vars in 1134 bytes} [Fri Oct 14 13:04:38 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:38.766767 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e956a66d-4834-478a-8e07-716a4952cc11 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] Calling method '.version_select at 0x7fbb81c268b0>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:38.846944 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e956a66d-4834-478a-8e07-716a4952cc11 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083824 Oct 14 13:04:38.847540 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 280/564] 10.222.0.47 () {58 vars in 1167 bytes} [Fri Oct 14 13:04:38 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:38.862070 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1da0791b-f172-4a56-b2ce-bcc5a2cdc797 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] Calling method '.version_select at 0x7fbb81a76310>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:38.942131 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1da0791b-f172-4a56-b2ce-bcc5a2cdc797 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084034 Oct 14 13:04:38.942694 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 285/565] 10.222.0.47 () {58 vars in 1170 bytes} [Fri Oct 14 13:04:38 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:38.956338 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-af79e2fa-2f47-4a17-b259-92327bea8f3d tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] Calling method '.version_select at 0x7fbb81bc2b80>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:39.038166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-af79e2fa-2f47-4a17-b259-92327bea8f3d tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.085449 Oct 14 13:04:39.038733 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 281/566] 10.222.0.47 () {58 vars in 1155 bytes} [Fri Oct 14 13:04:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:39.052842 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ab540000-3ece-4179-bb9d-0a5ef5f0abc6 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] Calling method '.version_select at 0x7fbb82adde50>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:39.286345 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ab540000-3ece-4179-bb9d-0a5ef5f0abc6 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.237248 Oct 14 13:04:39.286950 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 286/567] 10.222.0.47 () {58 vars in 1188 bytes} [Fri Oct 14 13:04:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:39.300876 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-310bc14f-298a-43b4-848c-d83f65ab4215 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] Calling method '.version_select at 0x7fbb81c14b80>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:39.380249 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-310bc14f-298a-43b4-848c-d83f65ab4215 tempest-VolumesTestJSON-273754163 tempest-VolumesTestJSON-273754163-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.083029 Oct 14 13:04:39.380813 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 282/568] 10.222.0.47 () {58 vars in 1155 bytes} [Fri Oct 14 13:04:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:39.463964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-dc3fcd81-b653-4150-962b-bdc6c2fe3dfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:39.464584 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-dc3fcd81-b653-4150-962b-bdc6c2fe3dfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:39.472333 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dc3fcd81-b653-4150-962b-bdc6c2fe3dfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:39.472829 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dc3fcd81-b653-4150-962b-bdc6c2fe3dfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:39.473269 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dc3fcd81-b653-4150-962b-bdc6c2fe3dfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:39.474014 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dc3fcd81-b653-4150-962b-bdc6c2fe3dfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:39.474476 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dc3fcd81-b653-4150-962b-bdc6c2fe3dfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:39.474907 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dc3fcd81-b653-4150-962b-bdc6c2fe3dfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:39.603181 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-dc3fcd81-b653-4150-962b-bdc6c2fe3dfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:39.612415 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-dc3fcd81-b653-4150-962b-bdc6c2fe3dfa tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 200 len: 1367 microversion: 2.1 time: 0.153173 Oct 14 13:04:39.613250 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 287/569] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:39 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:40.635390 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-22b1b9c0-766a-412c-bc5c-7f94f968ddb1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:40.636029 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-22b1b9c0-766a-412c-bc5c-7f94f968ddb1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:40.642598 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-22b1b9c0-766a-412c-bc5c-7f94f968ddb1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:40.643079 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-22b1b9c0-766a-412c-bc5c-7f94f968ddb1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:40.643510 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-22b1b9c0-766a-412c-bc5c-7f94f968ddb1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:40.644196 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-22b1b9c0-766a-412c-bc5c-7f94f968ddb1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:40.644644 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-22b1b9c0-766a-412c-bc5c-7f94f968ddb1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:40.645064 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-22b1b9c0-766a-412c-bc5c-7f94f968ddb1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:40.773392 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-22b1b9c0-766a-412c-bc5c-7f94f968ddb1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:40.781567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-22b1b9c0-766a-412c-bc5c-7f94f968ddb1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 200 len: 1367 microversion: 2.1 time: 0.150148 Oct 14 13:04:40.782133 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 283/570] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:40 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:41.724901 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-1caa55ba-b238-4b6b-b444-c335ac8b83bc req-d33c7080-ef31-4e39-a581-1ac06e3cc7fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a62f4f4-9e85-4d89-9580-445a0369cadc", "name": "network-vif-plugged", "status": "completed", "tag": "5d64d93f-8984-45dd-b22b-857d5d14a329"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:41.741130 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-1caa55ba-b238-4b6b-b444-c335ac8b83bc req-d33c7080-ef31-4e39-a581-1ac06e3cc7fc service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:41.741680 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-1caa55ba-b238-4b6b-b444-c335ac8b83bc req-d33c7080-ef31-4e39-a581-1ac06e3cc7fc service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:41.742105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-1caa55ba-b238-4b6b-b444-c335ac8b83bc req-d33c7080-ef31-4e39-a581-1ac06e3cc7fc service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:41.757090 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-1caa55ba-b238-4b6b-b444-c335ac8b83bc req-d33c7080-ef31-4e39-a581-1ac06e3cc7fc service nova] Creating event network-vif-plugged:5d64d93f-8984-45dd-b22b-857d5d14a329 for instance 5a62f4f4-9e85-4d89-9580-445a0369cadc on hv-cinder-82099 Oct 14 13:04:41.763037 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-1caa55ba-b238-4b6b-b444-c335ac8b83bc req-d33c7080-ef31-4e39-a581-1ac06e3cc7fc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045933 Oct 14 13:04:41.763657 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 288/571] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:41.804758 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5b27beb1-604a-4da0-846c-ebaf74aab6c2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:41.805369 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5b27beb1-604a-4da0-846c-ebaf74aab6c2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:41.812396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5b27beb1-604a-4da0-846c-ebaf74aab6c2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:41.813117 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5b27beb1-604a-4da0-846c-ebaf74aab6c2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:41.813400 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5b27beb1-604a-4da0-846c-ebaf74aab6c2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:41.814258 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5b27beb1-604a-4da0-846c-ebaf74aab6c2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:41.814709 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5b27beb1-604a-4da0-846c-ebaf74aab6c2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:41.815326 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5b27beb1-604a-4da0-846c-ebaf74aab6c2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:41.823653 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-dc6bd57e-362f-4fcd-8010-918857e33101 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:41.824264 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-dc6bd57e-362f-4fcd-8010-918857e33101 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:41.830399 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dc6bd57e-362f-4fcd-8010-918857e33101 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:41.830881 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dc6bd57e-362f-4fcd-8010-918857e33101 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:41.831307 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dc6bd57e-362f-4fcd-8010-918857e33101 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:41.831990 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dc6bd57e-362f-4fcd-8010-918857e33101 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:41.832470 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dc6bd57e-362f-4fcd-8010-918857e33101 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:41.832890 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dc6bd57e-362f-4fcd-8010-918857e33101 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:41.837961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:41.859170 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.objects.instance [None req-dc6bd57e-362f-4fcd-8010-918857e33101 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lazy-loading 'flavor' on Instance uuid 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f {{(pid=118868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:04:41.994827 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-5b27beb1-604a-4da0-846c-ebaf74aab6c2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:42.003353 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5b27beb1-604a-4da0-846c-ebaf74aab6c2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 200 len: 1367 microversion: 2.1 time: 0.202773 Oct 14 13:04:42.003930 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 284/572] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:41 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:42.018557 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-dc6bd57e-362f-4fcd-8010-918857e33101 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "POST /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f/action" status: 202 len: 0 microversion: 2.1 time: 0.199426 Oct 14 13:04:42.019311 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 289/573] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Oct 14 13:04:41 2022] POST /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 13:04:42.030716 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0efbe33f-108d-4802-a050-f7da4b4c8f50 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:42.031871 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-0efbe33f-108d-4802-a050-f7da4b4c8f50 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:42.043765 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0efbe33f-108d-4802-a050-f7da4b4c8f50 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:42.044440 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0efbe33f-108d-4802-a050-f7da4b4c8f50 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:42.045105 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0efbe33f-108d-4802-a050-f7da4b4c8f50 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:42.046077 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0efbe33f-108d-4802-a050-f7da4b4c8f50 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:42.046786 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0efbe33f-108d-4802-a050-f7da4b4c8f50 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:42.047451 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0efbe33f-108d-4802-a050-f7da4b4c8f50 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:42.193898 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-0efbe33f-108d-4802-a050-f7da4b4c8f50 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:42.202036 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-0efbe33f-108d-4802-a050-f7da4b4c8f50 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.175335 Oct 14 13:04:42.203618 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 285/574] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:42 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:43.027461 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-851a4054-0acf-47e0-8d04-4da1e9f8ab08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:43.028474 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-851a4054-0acf-47e0-8d04-4da1e9f8ab08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:43.034833 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-851a4054-0acf-47e0-8d04-4da1e9f8ab08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:43.035330 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-851a4054-0acf-47e0-8d04-4da1e9f8ab08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:43.035872 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-851a4054-0acf-47e0-8d04-4da1e9f8ab08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:43.036448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-851a4054-0acf-47e0-8d04-4da1e9f8ab08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:43.036902 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-851a4054-0acf-47e0-8d04-4da1e9f8ab08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:43.037327 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-851a4054-0acf-47e0-8d04-4da1e9f8ab08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:43.217990 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-851a4054-0acf-47e0-8d04-4da1e9f8ab08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:43.229020 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-07b64df0-2853-49b9-b19d-11815f1b54cf tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:43.229810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-07b64df0-2853-49b9-b19d-11815f1b54cf tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:43.232773 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:43.233413 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=6 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:43.237452 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07b64df0-2853-49b9-b19d-11815f1b54cf tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:43.239736 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-851a4054-0acf-47e0-8d04-4da1e9f8ab08 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 200 len: 1367 microversion: 2.1 time: 0.217624 Oct 14 13:04:43.240321 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 290/575] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:43 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:43.240828 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07b64df0-2853-49b9-b19d-11815f1b54cf tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:43.241349 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07b64df0-2853-49b9-b19d-11815f1b54cf tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:43.242382 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07b64df0-2853-49b9-b19d-11815f1b54cf tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:43.242544 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07b64df0-2853-49b9-b19d-11815f1b54cf tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:43.242968 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07b64df0-2853-49b9-b19d-11815f1b54cf tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:43.414052 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-07b64df0-2853-49b9-b19d-11815f1b54cf tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:43.423715 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-07b64df0-2853-49b9-b19d-11815f1b54cf tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.198401 Oct 14 13:04:43.424297 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 286/576] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:43 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:04:44.262951 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6fbfc9cf-a916-46f7-ba11-9efa2ea537cc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:44.263567 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-6fbfc9cf-a916-46f7-ba11-9efa2ea537cc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:44.265507 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=6 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:44.271281 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6fbfc9cf-a916-46f7-ba11-9efa2ea537cc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:44.271775 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6fbfc9cf-a916-46f7-ba11-9efa2ea537cc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:44.272400 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6fbfc9cf-a916-46f7-ba11-9efa2ea537cc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:44.273104 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6fbfc9cf-a916-46f7-ba11-9efa2ea537cc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:44.274069 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6fbfc9cf-a916-46f7-ba11-9efa2ea537cc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:44.275008 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6fbfc9cf-a916-46f7-ba11-9efa2ea537cc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:44.412958 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-6fbfc9cf-a916-46f7-ba11-9efa2ea537cc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:44.421693 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-6fbfc9cf-a916-46f7-ba11-9efa2ea537cc tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 200 len: 1556 microversion: 2.1 time: 0.163046 Oct 14 13:04:44.422308 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 291/577] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:44 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:44.445921 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-6c3e8d08-fccf-4fe8-8061-0b9dead8fee0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:44.446451 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-6c3e8d08-fccf-4fe8-8061-0b9dead8fee0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:44.447822 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9e822fc9-cf0b-4d8e-9fb5-50eb4220004a tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:44.448697 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-9e822fc9-cf0b-4d8e-9fb5-50eb4220004a tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:44.453415 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6c3e8d08-fccf-4fe8-8061-0b9dead8fee0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:44.454111 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6c3e8d08-fccf-4fe8-8061-0b9dead8fee0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:44.454546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6c3e8d08-fccf-4fe8-8061-0b9dead8fee0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:44.454686 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e822fc9-cf0b-4d8e-9fb5-50eb4220004a tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:44.455132 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e822fc9-cf0b-4d8e-9fb5-50eb4220004a tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:44.455245 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6c3e8d08-fccf-4fe8-8061-0b9dead8fee0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:44.455564 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e822fc9-cf0b-4d8e-9fb5-50eb4220004a tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:44.455680 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6c3e8d08-fccf-4fe8-8061-0b9dead8fee0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:44.456088 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6c3e8d08-fccf-4fe8-8061-0b9dead8fee0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:44.456375 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e822fc9-cf0b-4d8e-9fb5-50eb4220004a tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:44.456824 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e822fc9-cf0b-4d8e-9fb5-50eb4220004a tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:44.457416 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9e822fc9-cf0b-4d8e-9fb5-50eb4220004a tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:44.545983 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-6c3e8d08-fccf-4fe8-8061-0b9dead8fee0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104397 Oct 14 13:04:44.546765 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 287/578] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Oct 14 13:04:44 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:44.604125 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9e822fc9-cf0b-4d8e-9fb5-50eb4220004a tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:44.613467 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-9e822fc9-cf0b-4d8e-9fb5-50eb4220004a tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.169948 Oct 14 13:04:44.614072 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 292/579] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:44 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:04:45.638250 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-eb355733-463b-4343-91e8-63bec58c2ac1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:45.638813 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-eb355733-463b-4343-91e8-63bec58c2ac1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:45.644744 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-eb355733-463b-4343-91e8-63bec58c2ac1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:45.645229 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-eb355733-463b-4343-91e8-63bec58c2ac1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:45.645703 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-eb355733-463b-4343-91e8-63bec58c2ac1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:45.646402 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-eb355733-463b-4343-91e8-63bec58c2ac1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:45.646856 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-eb355733-463b-4343-91e8-63bec58c2ac1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:45.647279 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-eb355733-463b-4343-91e8-63bec58c2ac1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:45.767180 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-d85fdde0-94df-4354-89e7-721bcee5cc36 req-8109ab91-eac9-42bb-a6a9-c4d8204ab79f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a62f4f4-9e85-4d89-9580-445a0369cadc", "tag": "5d64d93f-8984-45dd-b22b-857d5d14a329"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:45.777092 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-d85fdde0-94df-4354-89e7-721bcee5cc36 req-8109ab91-eac9-42bb-a6a9-c4d8204ab79f service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:45.777607 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-d85fdde0-94df-4354-89e7-721bcee5cc36 req-8109ab91-eac9-42bb-a6a9-c4d8204ab79f service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:45.778434 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-d85fdde0-94df-4354-89e7-721bcee5cc36 req-8109ab91-eac9-42bb-a6a9-c4d8204ab79f service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:45.789432 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-d85fdde0-94df-4354-89e7-721bcee5cc36 req-8109ab91-eac9-42bb-a6a9-c4d8204ab79f service nova] Creating event network-changed:5d64d93f-8984-45dd-b22b-857d5d14a329 for instance 5a62f4f4-9e85-4d89-9580-445a0369cadc on hv-cinder-82099 Oct 14 13:04:45.794640 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-d85fdde0-94df-4354-89e7-721bcee5cc36 req-8109ab91-eac9-42bb-a6a9-c4d8204ab79f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031306 Oct 14 13:04:45.795951 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 293/580] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:04:45.830224 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-eb355733-463b-4343-91e8-63bec58c2ac1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:45.839105 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-eb355733-463b-4343-91e8-63bec58c2ac1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.205314 Oct 14 13:04:45.839898 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 288/581] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:45 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:46.863521 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4cc30f1f-ffbe-4fe0-967f-04a940c7b7b8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:46.864219 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-4cc30f1f-ffbe-4fe0-967f-04a940c7b7b8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:46.871598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4cc30f1f-ffbe-4fe0-967f-04a940c7b7b8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:46.872083 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4cc30f1f-ffbe-4fe0-967f-04a940c7b7b8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:46.872511 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4cc30f1f-ffbe-4fe0-967f-04a940c7b7b8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:46.873186 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4cc30f1f-ffbe-4fe0-967f-04a940c7b7b8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:46.873663 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4cc30f1f-ffbe-4fe0-967f-04a940c7b7b8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:46.874173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4cc30f1f-ffbe-4fe0-967f-04a940c7b7b8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:47.005220 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-4cc30f1f-ffbe-4fe0-967f-04a940c7b7b8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:47.013588 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4cc30f1f-ffbe-4fe0-967f-04a940c7b7b8 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.154619 Oct 14 13:04:47.014190 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 294/582] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:46 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:47.581520 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-34285555-9254-44d1-886d-2f2d423c3973 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:47.582085 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-34285555-9254-44d1-886d-2f2d423c3973 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:47.588454 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34285555-9254-44d1-886d-2f2d423c3973 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:47.589094 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34285555-9254-44d1-886d-2f2d423c3973 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:47.589543 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34285555-9254-44d1-886d-2f2d423c3973 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:47.590233 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34285555-9254-44d1-886d-2f2d423c3973 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:47.590684 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34285555-9254-44d1-886d-2f2d423c3973 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:47.591102 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34285555-9254-44d1-886d-2f2d423c3973 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:47.617021 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-34285555-9254-44d1-886d-2f2d423c3973 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87/ips" status: 200 len: 153 microversion: 2.20 time: 0.039212 Oct 14 13:04:47.624617 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 289/583] 10.222.0.47 () {60 vars in 1289 bytes} [Fri Oct 14 13:04:47 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87/ips => generated 153 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 13:04:48.036911 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-dcb27bc8-f6ea-4c88-8f9e-e1c92cf21e19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:48.037594 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-dcb27bc8-f6ea-4c88-8f9e-e1c92cf21e19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:48.044525 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dcb27bc8-f6ea-4c88-8f9e-e1c92cf21e19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:48.045011 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dcb27bc8-f6ea-4c88-8f9e-e1c92cf21e19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:48.045451 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dcb27bc8-f6ea-4c88-8f9e-e1c92cf21e19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:48.046176 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dcb27bc8-f6ea-4c88-8f9e-e1c92cf21e19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:48.046668 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dcb27bc8-f6ea-4c88-8f9e-e1c92cf21e19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:48.047095 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dcb27bc8-f6ea-4c88-8f9e-e1c92cf21e19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:48.177883 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-dcb27bc8-f6ea-4c88-8f9e-e1c92cf21e19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:48.185730 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-dcb27bc8-f6ea-4c88-8f9e-e1c92cf21e19 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.152627 Oct 14 13:04:48.186331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 295/584] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:48 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:49.208639 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4415e4f8-fd74-4e3d-b36e-e63336e849c0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:49.209260 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4415e4f8-fd74-4e3d-b36e-e63336e849c0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:49.211130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:49.217050 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4415e4f8-fd74-4e3d-b36e-e63336e849c0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:49.217551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4415e4f8-fd74-4e3d-b36e-e63336e849c0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:49.217983 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4415e4f8-fd74-4e3d-b36e-e63336e849c0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:49.218662 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4415e4f8-fd74-4e3d-b36e-e63336e849c0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:49.219105 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4415e4f8-fd74-4e3d-b36e-e63336e849c0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:49.219521 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4415e4f8-fd74-4e3d-b36e-e63336e849c0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:49.352837 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4415e4f8-fd74-4e3d-b36e-e63336e849c0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:49.360732 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4415e4f8-fd74-4e3d-b36e-e63336e849c0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.155948 Oct 14 13:04:49.361284 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 290/585] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:49 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:50.383687 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b84f8549-ae80-4d06-9840-980b3340aef4 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:50.384292 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b84f8549-ae80-4d06-9840-980b3340aef4 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:50.390916 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b84f8549-ae80-4d06-9840-980b3340aef4 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:50.391386 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b84f8549-ae80-4d06-9840-980b3340aef4 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:50.391820 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b84f8549-ae80-4d06-9840-980b3340aef4 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:50.392506 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b84f8549-ae80-4d06-9840-980b3340aef4 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:50.392957 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b84f8549-ae80-4d06-9840-980b3340aef4 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:50.393382 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b84f8549-ae80-4d06-9840-980b3340aef4 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:50.522395 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b84f8549-ae80-4d06-9840-980b3340aef4 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:50.530655 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b84f8549-ae80-4d06-9840-980b3340aef4 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.150825 Oct 14 13:04:50.531241 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 296/586] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:50 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:50.601576 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-72e783ad-62b5-4b36-a99d-74038f6f0f28 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:50.602648 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-72e783ad-62b5-4b36-a99d-74038f6f0f28 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:50.608480 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-72e783ad-62b5-4b36-a99d-74038f6f0f28 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:50.608958 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-72e783ad-62b5-4b36-a99d-74038f6f0f28 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:50.609387 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-72e783ad-62b5-4b36-a99d-74038f6f0f28 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:50.610350 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-72e783ad-62b5-4b36-a99d-74038f6f0f28 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:50.610830 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-72e783ad-62b5-4b36-a99d-74038f6f0f28 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:50.611241 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-72e783ad-62b5-4b36-a99d-74038f6f0f28 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:50.634262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-72e783ad-62b5-4b36-a99d-74038f6f0f28 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/ips" status: 200 len: 146 microversion: 2.1 time: 0.036439 Oct 14 13:04:50.634742 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 291/587] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Oct 14 13:04:50 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:51.554499 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b93d120c-5f0e-4f6e-a993-06a0ab8b86fe tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:51.555754 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b93d120c-5f0e-4f6e-a993-06a0ab8b86fe tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:51.562070 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b93d120c-5f0e-4f6e-a993-06a0ab8b86fe tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:51.562551 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b93d120c-5f0e-4f6e-a993-06a0ab8b86fe tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:51.562981 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b93d120c-5f0e-4f6e-a993-06a0ab8b86fe tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:51.563661 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b93d120c-5f0e-4f6e-a993-06a0ab8b86fe tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:51.564124 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b93d120c-5f0e-4f6e-a993-06a0ab8b86fe tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:51.564528 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b93d120c-5f0e-4f6e-a993-06a0ab8b86fe tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:51.695946 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b93d120c-5f0e-4f6e-a993-06a0ab8b86fe tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:51.703653 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b93d120c-5f0e-4f6e-a993-06a0ab8b86fe tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.152970 Oct 14 13:04:51.704217 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 297/588] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:51 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:52.070684 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5a81e620-c10b-43ae-974b-84265b741549 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4b990d6-60d8-49c6-a113-f10f74aef659"}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:52.073091 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5a81e620-c10b-43ae-974b-84265b741549 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:52.079969 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5a81e620-c10b-43ae-974b-84265b741549 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:52.080561 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5a81e620-c10b-43ae-974b-84265b741549 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:52.080975 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5a81e620-c10b-43ae-974b-84265b741549 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:52.081711 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5a81e620-c10b-43ae-974b-84265b741549 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:52.082164 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5a81e620-c10b-43ae-974b-84265b741549 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:52.082604 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5a81e620-c10b-43ae-974b-84265b741549 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:52.371244 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5a81e620-c10b-43ae-974b-84265b741549 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "POST /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304494 Oct 14 13:04:52.371998 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 292/589] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Oct 14 13:04:52 2022] POST /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:52.726997 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4539b072-a128-40c2-9d7a-5987f03acb43 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:52.728142 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-4539b072-a128-40c2-9d7a-5987f03acb43 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:52.734489 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4539b072-a128-40c2-9d7a-5987f03acb43 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:52.735233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4539b072-a128-40c2-9d7a-5987f03acb43 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:52.735666 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4539b072-a128-40c2-9d7a-5987f03acb43 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:52.736349 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4539b072-a128-40c2-9d7a-5987f03acb43 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:52.736848 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4539b072-a128-40c2-9d7a-5987f03acb43 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:52.737247 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4539b072-a128-40c2-9d7a-5987f03acb43 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:52.947187 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-4539b072-a128-40c2-9d7a-5987f03acb43 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:52.955583 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4539b072-a128-40c2-9d7a-5987f03acb43 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.232403 Oct 14 13:04:52.956682 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 298/590] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:52 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:52.990296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-9f2248b3-530f-41c8-add6-90c04522464c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:52.990951 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-9f2248b3-530f-41c8-add6-90c04522464c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:52.998482 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9f2248b3-530f-41c8-add6-90c04522464c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:52.998970 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9f2248b3-530f-41c8-add6-90c04522464c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:52.999399 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9f2248b3-530f-41c8-add6-90c04522464c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:53.000096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9f2248b3-530f-41c8-add6-90c04522464c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:53.000544 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9f2248b3-530f-41c8-add6-90c04522464c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:53.000967 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9f2248b3-530f-41c8-add6-90c04522464c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:53.023914 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-9f2248b3-530f-41c8-add6-90c04522464c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lazy-loading 'flavor' on Instance uuid 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:04:53.212786 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-9f2248b3-530f-41c8-add6-90c04522464c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "POST /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87/action" status: 202 len: 0 microversion: 2.20 time: 0.229178 Oct 14 13:04:53.213355 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 293/591] 10.222.0.47 () {62 vars in 1319 bytes} [Fri Oct 14 13:04:52 2022] POST /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:04:53.221356 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f28cfe9c-9450-4af6-b85c-40d9d9894c6c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:53.221980 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-f28cfe9c-9450-4af6-b85c-40d9d9894c6c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:53.228832 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f28cfe9c-9450-4af6-b85c-40d9d9894c6c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:53.229297 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f28cfe9c-9450-4af6-b85c-40d9d9894c6c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:53.229765 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f28cfe9c-9450-4af6-b85c-40d9d9894c6c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:53.230453 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f28cfe9c-9450-4af6-b85c-40d9d9894c6c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:53.230903 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f28cfe9c-9450-4af6-b85c-40d9d9894c6c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:53.231325 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f28cfe9c-9450-4af6-b85c-40d9d9894c6c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:53.360718 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f28cfe9c-9450-4af6-b85c-40d9d9894c6c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:53.368695 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f28cfe9c-9450-4af6-b85c-40d9d9894c6c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:53.370180 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f28cfe9c-9450-4af6-b85c-40d9d9894c6c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:53.371335 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f28cfe9c-9450-4af6-b85c-40d9d9894c6c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.153822 Oct 14 13:04:53.371893 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 299/592] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:53 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:04:53.979584 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-afee1ade-49c5-42fa-b51b-347bae4a1c06 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:53.980713 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-afee1ade-49c5-42fa-b51b-347bae4a1c06 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:53.989720 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-afee1ade-49c5-42fa-b51b-347bae4a1c06 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:53.990199 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-afee1ade-49c5-42fa-b51b-347bae4a1c06 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:53.990823 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-afee1ade-49c5-42fa-b51b-347bae4a1c06 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:53.991509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-afee1ade-49c5-42fa-b51b-347bae4a1c06 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:53.991957 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-afee1ade-49c5-42fa-b51b-347bae4a1c06 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:53.992392 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-afee1ade-49c5-42fa-b51b-347bae4a1c06 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:54.126645 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-afee1ade-49c5-42fa-b51b-347bae4a1c06 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:54.135214 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-afee1ade-49c5-42fa-b51b-347bae4a1c06 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.159967 Oct 14 13:04:54.135780 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 294/593] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:53 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:54.396220 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ec52645c-9e48-4814-a2e9-71757354e6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:54.396823 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-ec52645c-9e48-4814-a2e9-71757354e6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:54.403291 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ec52645c-9e48-4814-a2e9-71757354e6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:54.403769 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ec52645c-9e48-4814-a2e9-71757354e6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:54.404199 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ec52645c-9e48-4814-a2e9-71757354e6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:54.404880 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ec52645c-9e48-4814-a2e9-71757354e6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:54.405335 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ec52645c-9e48-4814-a2e9-71757354e6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:54.405782 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ec52645c-9e48-4814-a2e9-71757354e6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:54.532695 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ec52645c-9e48-4814-a2e9-71757354e6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:54.541432 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ec52645c-9e48-4814-a2e9-71757354e6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:54.542897 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ec52645c-9e48-4814-a2e9-71757354e6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:54.544049 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ec52645c-9e48-4814-a2e9-71757354e6f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.151751 Oct 14 13:04:54.544583 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 300/594] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:54 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:04:55.161159 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-6f0338cc-9351-4339-82de-0922733796d9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:55.162625 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-6f0338cc-9351-4339-82de-0922733796d9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:55.169979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6f0338cc-9351-4339-82de-0922733796d9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:55.170635 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6f0338cc-9351-4339-82de-0922733796d9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:55.171173 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6f0338cc-9351-4339-82de-0922733796d9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:55.172262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6f0338cc-9351-4339-82de-0922733796d9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:55.172798 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6f0338cc-9351-4339-82de-0922733796d9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:55.173762 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6f0338cc-9351-4339-82de-0922733796d9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:55.337073 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-6f0338cc-9351-4339-82de-0922733796d9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:55.346022 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-6f0338cc-9351-4339-82de-0922733796d9 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.191216 Oct 14 13:04:55.346658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 295/595] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:55 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:55.569852 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-bb64d04c-a2ca-4ff2-bc07-d47c6b876030 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:55.570605 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-bb64d04c-a2ca-4ff2-bc07-d47c6b876030 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:55.577232 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bb64d04c-a2ca-4ff2-bc07-d47c6b876030 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:55.577871 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bb64d04c-a2ca-4ff2-bc07-d47c6b876030 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:55.578553 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bb64d04c-a2ca-4ff2-bc07-d47c6b876030 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:55.579462 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bb64d04c-a2ca-4ff2-bc07-d47c6b876030 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:55.579989 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bb64d04c-a2ca-4ff2-bc07-d47c6b876030 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:55.580474 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bb64d04c-a2ca-4ff2-bc07-d47c6b876030 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:55.687514 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e14cbaa2-53b3-40fb-9149-d80f37d23b4a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:55.689710 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e14cbaa2-53b3-40fb-9149-d80f37d23b4a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:55.695691 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e14cbaa2-53b3-40fb-9149-d80f37d23b4a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:55.696330 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e14cbaa2-53b3-40fb-9149-d80f37d23b4a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:55.697261 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e14cbaa2-53b3-40fb-9149-d80f37d23b4a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:55.698028 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e14cbaa2-53b3-40fb-9149-d80f37d23b4a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:55.698489 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e14cbaa2-53b3-40fb-9149-d80f37d23b4a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:55.699435 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e14cbaa2-53b3-40fb-9149-d80f37d23b4a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:55.722346 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-bb64d04c-a2ca-4ff2-bc07-d47c6b876030 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:55.725075 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:55.730671 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e14cbaa2-53b3-40fb-9149-d80f37d23b4a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047101 Oct 14 13:04:55.731233 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 296/596] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:04:55 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:04:55.732428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-bb64d04c-a2ca-4ff2-bc07-d47c6b876030 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:55.734425 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-bb64d04c-a2ca-4ff2-bc07-d47c6b876030 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:55.736024 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-bb64d04c-a2ca-4ff2-bc07-d47c6b876030 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.170400 Oct 14 13:04:55.736725 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 301/597] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:55 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:04:55.744307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-1e3eff5e-3f6f-4865-aa6b-35ff58fd4e84 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:55.745593 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-1e3eff5e-3f6f-4865-aa6b-35ff58fd4e84 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:55.752037 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1e3eff5e-3f6f-4865-aa6b-35ff58fd4e84 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:55.752577 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1e3eff5e-3f6f-4865-aa6b-35ff58fd4e84 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:55.753005 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1e3eff5e-3f6f-4865-aa6b-35ff58fd4e84 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:55.753712 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1e3eff5e-3f6f-4865-aa6b-35ff58fd4e84 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:55.754164 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1e3eff5e-3f6f-4865-aa6b-35ff58fd4e84 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:55.754575 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1e3eff5e-3f6f-4865-aa6b-35ff58fd4e84 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:55.785094 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-1e3eff5e-3f6f-4865-aa6b-35ff58fd4e84 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments/b4b990d6-60d8-49c6-a113-f10f74aef659" status: 200 len: 194 microversion: 2.1 time: 0.046913 Oct 14 13:04:55.787966 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 297/598] 10.222.0.47 () {58 vars in 1413 bytes} [Fri Oct 14 13:04:55 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments/b4b990d6-60d8-49c6-a113-f10f74aef659 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:56.370419 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0fdb3972-ed48-4fcf-b6a4-39f718cb37d0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:56.371034 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0fdb3972-ed48-4fcf-b6a4-39f718cb37d0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:56.376909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0fdb3972-ed48-4fcf-b6a4-39f718cb37d0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:56.377387 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0fdb3972-ed48-4fcf-b6a4-39f718cb37d0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:56.377847 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0fdb3972-ed48-4fcf-b6a4-39f718cb37d0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:56.378525 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0fdb3972-ed48-4fcf-b6a4-39f718cb37d0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:56.379001 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0fdb3972-ed48-4fcf-b6a4-39f718cb37d0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:56.379420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0fdb3972-ed48-4fcf-b6a4-39f718cb37d0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:56.511382 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0fdb3972-ed48-4fcf-b6a4-39f718cb37d0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:56.519464 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0fdb3972-ed48-4fcf-b6a4-39f718cb37d0 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1509 microversion: 2.1 time: 0.153008 Oct 14 13:04:56.520197 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 302/599] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:56 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:56.543326 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-af23a9ce-0734-4ef0-a512-600482c8dc6d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:56.544032 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-af23a9ce-0734-4ef0-a512-600482c8dc6d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:56.550617 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af23a9ce-0734-4ef0-a512-600482c8dc6d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:56.551204 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af23a9ce-0734-4ef0-a512-600482c8dc6d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:56.551760 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af23a9ce-0734-4ef0-a512-600482c8dc6d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:56.552514 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af23a9ce-0734-4ef0-a512-600482c8dc6d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:56.552973 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af23a9ce-0734-4ef0-a512-600482c8dc6d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:56.553402 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af23a9ce-0734-4ef0-a512-600482c8dc6d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:56.691784 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-af23a9ce-0734-4ef0-a512-600482c8dc6d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118869) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 14 13:04:56.758073 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-af23a9ce-0734-4ef0-a512-600482c8dc6d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "POST /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f/action" status: 202 len: 0 microversion: 2.1 time: 0.217974 Oct 14 13:04:56.758073 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 298/600] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Oct 14 13:04:56 2022] POST /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:04:56.764383 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-3e573ec1-3247-4768-ad94-576d6b8d6042 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:56.765043 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-3e573ec1-3247-4768-ad94-576d6b8d6042 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:56.766738 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-6e18a25e-d41f-4fe4-be79-774a7bc340f1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:56.767422 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-6e18a25e-d41f-4fe4-be79-774a7bc340f1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:56.772168 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e573ec1-3247-4768-ad94-576d6b8d6042 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:56.772898 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e573ec1-3247-4768-ad94-576d6b8d6042 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:56.773317 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e573ec1-3247-4768-ad94-576d6b8d6042 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:56.774033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e573ec1-3247-4768-ad94-576d6b8d6042 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:56.774414 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6e18a25e-d41f-4fe4-be79-774a7bc340f1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:56.775662 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6e18a25e-d41f-4fe4-be79-774a7bc340f1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:56.775982 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6e18a25e-d41f-4fe4-be79-774a7bc340f1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:56.776281 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e573ec1-3247-4768-ad94-576d6b8d6042 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:56.776855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6e18a25e-d41f-4fe4-be79-774a7bc340f1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:56.776989 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e573ec1-3247-4768-ad94-576d6b8d6042 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:56.777374 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6e18a25e-d41f-4fe4-be79-774a7bc340f1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:56.777856 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6e18a25e-d41f-4fe4-be79-774a7bc340f1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:56.930393 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-6e18a25e-d41f-4fe4-be79-774a7bc340f1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:56.939653 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-6e18a25e-d41f-4fe4-be79-774a7bc340f1 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1517 microversion: 2.1 time: 0.177145 Oct 14 13:04:56.940220 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 299/601] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:56 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:56.945899 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3e573ec1-3247-4768-ad94-576d6b8d6042 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:56.954493 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3e573ec1-3247-4768-ad94-576d6b8d6042 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:56.956430 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3e573ec1-3247-4768-ad94-576d6b8d6042 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:56.957897 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-3e573ec1-3247-4768-ad94-576d6b8d6042 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.197849 Oct 14 13:04:56.959617 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 303/602] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:56 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:04:57.121316 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-1a390065-d18c-450e-9756-9eb57d4b7144 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29aaed04-8cb8-4219-b2b4-66d6ab97c754"}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:57.123621 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-1a390065-d18c-450e-9756-9eb57d4b7144 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:57.129712 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1a390065-d18c-450e-9756-9eb57d4b7144 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:57.130222 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1a390065-d18c-450e-9756-9eb57d4b7144 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:57.130672 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1a390065-d18c-450e-9756-9eb57d4b7144 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:57.131450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1a390065-d18c-450e-9756-9eb57d4b7144 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:57.131898 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1a390065-d18c-450e-9756-9eb57d4b7144 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:57.132321 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1a390065-d18c-450e-9756-9eb57d4b7144 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:57.376147 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-1a390065-d18c-450e-9756-9eb57d4b7144 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "POST /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258593 Oct 14 13:04:57.376900 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 300/603] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Oct 14 13:04:57 2022] POST /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:04:57.752728 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-6d456ce6-ca3b-4f50-aae0-dfbff0761a43 req-75bf5b1c-eba7-4512-a5ac-2aaf4509912e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f", "name": "network-vif-unplugged", "status": "completed", "tag": "5974c9e5-7b5e-4f03-aaed-db90e7d7a18e"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:04:57.764020 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-6d456ce6-ca3b-4f50-aae0-dfbff0761a43 req-75bf5b1c-eba7-4512-a5ac-2aaf4509912e service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:57.764608 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-6d456ce6-ca3b-4f50-aae0-dfbff0761a43 req-75bf5b1c-eba7-4512-a5ac-2aaf4509912e service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:57.765199 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-6d456ce6-ca3b-4f50-aae0-dfbff0761a43 req-75bf5b1c-eba7-4512-a5ac-2aaf4509912e service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:57.777092 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.compute.server_external_events [req-6d456ce6-ca3b-4f50-aae0-dfbff0761a43 req-75bf5b1c-eba7-4512-a5ac-2aaf4509912e service nova] Unable to find a host for instance 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f. Dropping event network-vif-unplugged {{(pid=118868) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 14 13:04:57.778076 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-6d456ce6-ca3b-4f50-aae0-dfbff0761a43 req-75bf5b1c-eba7-4512-a5ac-2aaf4509912e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033427 Oct 14 13:04:57.778874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 304/604] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 14 13:04:57.965820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8fe63b25-ca03-46a8-9d1f-7876ba96f7d3 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:57.966532 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8fe63b25-ca03-46a8-9d1f-7876ba96f7d3 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:57.972658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fe63b25-ca03-46a8-9d1f-7876ba96f7d3 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:57.973119 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fe63b25-ca03-46a8-9d1f-7876ba96f7d3 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:57.973579 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fe63b25-ca03-46a8-9d1f-7876ba96f7d3 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:57.983937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9d260d7e-e0bb-4dc6-be05-2481e1b0da74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:57.984604 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-9d260d7e-e0bb-4dc6-be05-2481e1b0da74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:57.987715 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fe63b25-ca03-46a8-9d1f-7876ba96f7d3 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:57.989263 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fe63b25-ca03-46a8-9d1f-7876ba96f7d3 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:57.989904 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8fe63b25-ca03-46a8-9d1f-7876ba96f7d3 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:57.992463 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9d260d7e-e0bb-4dc6-be05-2481e1b0da74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:57.992959 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9d260d7e-e0bb-4dc6-be05-2481e1b0da74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:57.994372 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9d260d7e-e0bb-4dc6-be05-2481e1b0da74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:57.995639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9d260d7e-e0bb-4dc6-be05-2481e1b0da74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:57.996605 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9d260d7e-e0bb-4dc6-be05-2481e1b0da74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:57.997626 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9d260d7e-e0bb-4dc6-be05-2481e1b0da74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:58.002480 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:04:58.147846 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9d260d7e-e0bb-4dc6-be05-2481e1b0da74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:58.150848 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8fe63b25-ca03-46a8-9d1f-7876ba96f7d3 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:58.157765 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9d260d7e-e0bb-4dc6-be05-2481e1b0da74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:58.159065 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8fe63b25-ca03-46a8-9d1f-7876ba96f7d3 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1519 microversion: 2.1 time: 0.198946 Oct 14 13:04:58.159397 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9d260d7e-e0bb-4dc6-be05-2481e1b0da74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:58.160011 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 301/605] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:57 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1519 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:04:58.161361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-9d260d7e-e0bb-4dc6-be05-2481e1b0da74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.180861 Oct 14 13:04:58.161941 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 305/606] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:57 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:04:59.182542 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-6d8a1069-9f41-4385-b5d6-95ecff6c017d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:59.183271 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-6d8a1069-9f41-4385-b5d6-95ecff6c017d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:59.186056 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-33602582-0270-4401-b233-285d123d615c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:04:59.186662 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-33602582-0270-4401-b233-285d123d615c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:04:59.189902 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d8a1069-9f41-4385-b5d6-95ecff6c017d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:59.190486 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d8a1069-9f41-4385-b5d6-95ecff6c017d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:59.191173 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d8a1069-9f41-4385-b5d6-95ecff6c017d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:59.191994 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d8a1069-9f41-4385-b5d6-95ecff6c017d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:59.192539 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d8a1069-9f41-4385-b5d6-95ecff6c017d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:59.192868 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33602582-0270-4401-b233-285d123d615c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:59.193390 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d8a1069-9f41-4385-b5d6-95ecff6c017d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:59.193560 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33602582-0270-4401-b233-285d123d615c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:59.193957 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33602582-0270-4401-b233-285d123d615c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:59.194844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33602582-0270-4401-b233-285d123d615c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:04:59.195301 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33602582-0270-4401-b233-285d123d615c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:04:59.195727 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-33602582-0270-4401-b233-285d123d615c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:04:59.346577 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-33602582-0270-4401-b233-285d123d615c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:59.350154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-6d8a1069-9f41-4385-b5d6-95ecff6c017d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:59.357005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-33602582-0270-4401-b233-285d123d615c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:59.358618 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-33602582-0270-4401-b233-285d123d615c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:04:59.360886 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-6d8a1069-9f41-4385-b5d6-95ecff6c017d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1519 microversion: 2.1 time: 0.181247 Oct 14 13:04:59.361043 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-33602582-0270-4401-b233-285d123d615c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.177685 Oct 14 13:04:59.361043 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 306/607] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:04:59 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:04:59.361407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 302/608] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:04:59 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:00.384293 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d0bbdd84-f8f8-4ab3-bf74-d4af48cd87aa tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:00.384904 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-d0bbdd84-f8f8-4ab3-bf74-d4af48cd87aa tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:00.385436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-79a31476-bbc8-4b9b-bcf8-7bf9e301eb54 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:00.386067 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-79a31476-bbc8-4b9b-bcf8-7bf9e301eb54 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:00.391467 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0bbdd84-f8f8-4ab3-bf74-d4af48cd87aa tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:00.391949 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0bbdd84-f8f8-4ab3-bf74-d4af48cd87aa tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:00.392752 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0bbdd84-f8f8-4ab3-bf74-d4af48cd87aa tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:00.393059 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0bbdd84-f8f8-4ab3-bf74-d4af48cd87aa tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:00.393542 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0bbdd84-f8f8-4ab3-bf74-d4af48cd87aa tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:00.393965 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0bbdd84-f8f8-4ab3-bf74-d4af48cd87aa tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:00.395779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-79a31476-bbc8-4b9b-bcf8-7bf9e301eb54 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:00.396284 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-79a31476-bbc8-4b9b-bcf8-7bf9e301eb54 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:00.396690 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-79a31476-bbc8-4b9b-bcf8-7bf9e301eb54 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:00.397385 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-79a31476-bbc8-4b9b-bcf8-7bf9e301eb54 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:00.398977 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-79a31476-bbc8-4b9b-bcf8-7bf9e301eb54 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:00.398977 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-79a31476-bbc8-4b9b-bcf8-7bf9e301eb54 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:00.528970 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-d0bbdd84-f8f8-4ab3-bf74-d4af48cd87aa tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:00.533888 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-79a31476-bbc8-4b9b-bcf8-7bf9e301eb54 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:00.546460 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-d0bbdd84-f8f8-4ab3-bf74-d4af48cd87aa tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1519 microversion: 2.1 time: 0.158077 Oct 14 13:05:00.546460 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 307/609] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:00 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:00.546664 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-79a31476-bbc8-4b9b-bcf8-7bf9e301eb54 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:00.546664 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-79a31476-bbc8-4b9b-bcf8-7bf9e301eb54 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:00.546664 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-79a31476-bbc8-4b9b-bcf8-7bf9e301eb54 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.164058 Oct 14 13:05:00.546942 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 303/610] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:00 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:05:01.562777 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0a2ef4b7-3385-4ef3-a2e2-7df2e2539342 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:01.563385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0a2ef4b7-3385-4ef3-a2e2-7df2e2539342 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:01.570078 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0a2ef4b7-3385-4ef3-a2e2-7df2e2539342 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:01.570569 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0a2ef4b7-3385-4ef3-a2e2-7df2e2539342 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:01.571003 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0a2ef4b7-3385-4ef3-a2e2-7df2e2539342 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:01.571587 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-980a1771-2f9a-491b-9e7c-0829ef410763 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:01.572012 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0a2ef4b7-3385-4ef3-a2e2-7df2e2539342 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:01.572186 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-980a1771-2f9a-491b-9e7c-0829ef410763 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:01.572305 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0a2ef4b7-3385-4ef3-a2e2-7df2e2539342 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:01.572608 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0a2ef4b7-3385-4ef3-a2e2-7df2e2539342 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:01.579171 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-980a1771-2f9a-491b-9e7c-0829ef410763 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:01.579639 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-980a1771-2f9a-491b-9e7c-0829ef410763 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:01.580063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-980a1771-2f9a-491b-9e7c-0829ef410763 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:01.580745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-980a1771-2f9a-491b-9e7c-0829ef410763 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:01.581190 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-980a1771-2f9a-491b-9e7c-0829ef410763 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:01.581633 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-980a1771-2f9a-491b-9e7c-0829ef410763 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:01.710392 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0a2ef4b7-3385-4ef3-a2e2-7df2e2539342 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:01.718407 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0a2ef4b7-3385-4ef3-a2e2-7df2e2539342 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1519 microversion: 2.1 time: 0.159430 Oct 14 13:05:01.718976 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 308/611] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:01 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:01.726000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-980a1771-2f9a-491b-9e7c-0829ef410763 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:01.734415 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-980a1771-2f9a-491b-9e7c-0829ef410763 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:01.736244 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-980a1771-2f9a-491b-9e7c-0829ef410763 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:01.737395 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-980a1771-2f9a-491b-9e7c-0829ef410763 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.170344 Oct 14 13:05:01.738005 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 304/612] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:01 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:05:02.743460 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b7f2df45-14bd-451b-98e7-9a29acd035da tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:02.744175 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b7f2df45-14bd-451b-98e7-9a29acd035da tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:02.750858 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b7f2df45-14bd-451b-98e7-9a29acd035da tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:02.751350 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b7f2df45-14bd-451b-98e7-9a29acd035da tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:02.751787 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b7f2df45-14bd-451b-98e7-9a29acd035da tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:02.752479 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b7f2df45-14bd-451b-98e7-9a29acd035da tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:02.752938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b7f2df45-14bd-451b-98e7-9a29acd035da tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:02.753368 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b7f2df45-14bd-451b-98e7-9a29acd035da tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:02.763871 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-850f894e-d633-4a63-9a13-0ba38cfacf9d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:02.764477 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-850f894e-d633-4a63-9a13-0ba38cfacf9d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:02.770873 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-850f894e-d633-4a63-9a13-0ba38cfacf9d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:02.771349 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-850f894e-d633-4a63-9a13-0ba38cfacf9d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:02.771789 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-850f894e-d633-4a63-9a13-0ba38cfacf9d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:02.772470 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-850f894e-d633-4a63-9a13-0ba38cfacf9d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:02.772916 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-850f894e-d633-4a63-9a13-0ba38cfacf9d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:02.773333 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-850f894e-d633-4a63-9a13-0ba38cfacf9d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:02.891096 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b7f2df45-14bd-451b-98e7-9a29acd035da tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:02.899002 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b7f2df45-14bd-451b-98e7-9a29acd035da tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1519 microversion: 2.1 time: 0.159401 Oct 14 13:05:02.899983 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-850f894e-d633-4a63-9a13-0ba38cfacf9d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:02.900229 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 309/613] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:02 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:02.908189 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-850f894e-d633-4a63-9a13-0ba38cfacf9d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:02.909662 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-850f894e-d633-4a63-9a13-0ba38cfacf9d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:02.910802 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-850f894e-d633-4a63-9a13-0ba38cfacf9d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.151015 Oct 14 13:05:02.911347 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 305/614] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:02 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:05:03.922511 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6142e083-2466-4469-829f-788b88272a74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:03.923125 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-6142e083-2466-4469-829f-788b88272a74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:03.929647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6142e083-2466-4469-829f-788b88272a74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:03.930136 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6142e083-2466-4469-829f-788b88272a74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:03.930869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6142e083-2466-4469-829f-788b88272a74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:03.931568 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6142e083-2466-4469-829f-788b88272a74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:03.932020 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6142e083-2466-4469-829f-788b88272a74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:03.932646 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6142e083-2466-4469-829f-788b88272a74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:03.935741 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-875bcbaf-8bad-40ad-8689-f7de44826c56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:03.936501 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-875bcbaf-8bad-40ad-8689-f7de44826c56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:03.943211 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-875bcbaf-8bad-40ad-8689-f7de44826c56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:03.943695 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-875bcbaf-8bad-40ad-8689-f7de44826c56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:03.944156 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-875bcbaf-8bad-40ad-8689-f7de44826c56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:03.944895 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-875bcbaf-8bad-40ad-8689-f7de44826c56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:03.945352 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-875bcbaf-8bad-40ad-8689-f7de44826c56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:03.945808 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-875bcbaf-8bad-40ad-8689-f7de44826c56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:04.066330 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-6142e083-2466-4469-829f-788b88272a74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:04.074387 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-6142e083-2466-4469-829f-788b88272a74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1519 microversion: 2.1 time: 0.155702 Oct 14 13:05:04.074963 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 310/615] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:03 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:04.082531 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-875bcbaf-8bad-40ad-8689-f7de44826c56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:04.091153 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-875bcbaf-8bad-40ad-8689-f7de44826c56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:04.092603 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-875bcbaf-8bad-40ad-8689-f7de44826c56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:04.093773 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-875bcbaf-8bad-40ad-8689-f7de44826c56 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.162011 Oct 14 13:05:04.094316 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 306/616] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:03 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:05:04.930874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1fd9a4c2-80d7-4975-8057-63642a835969 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:04.933086 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1fd9a4c2-80d7-4975-8057-63642a835969 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:04.939558 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1fd9a4c2-80d7-4975-8057-63642a835969 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:04.940036 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1fd9a4c2-80d7-4975-8057-63642a835969 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:04.940461 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1fd9a4c2-80d7-4975-8057-63642a835969 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:04.941142 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1fd9a4c2-80d7-4975-8057-63642a835969 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:04.941620 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1fd9a4c2-80d7-4975-8057-63642a835969 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:04.942038 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1fd9a4c2-80d7-4975-8057-63642a835969 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:04.974157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1fd9a4c2-80d7-4975-8057-63642a835969 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047080 Oct 14 13:05:04.975060 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 311/617] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:05:04 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:05.098385 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2fffad2a-4946-4e75-8122-d11f9cac3d33 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:05.099077 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-2fffad2a-4946-4e75-8122-d11f9cac3d33 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:05.105609 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2fffad2a-4946-4e75-8122-d11f9cac3d33 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:05.106172 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2fffad2a-4946-4e75-8122-d11f9cac3d33 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:05.106699 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2fffad2a-4946-4e75-8122-d11f9cac3d33 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:05.107487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2fffad2a-4946-4e75-8122-d11f9cac3d33 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:05.107989 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2fffad2a-4946-4e75-8122-d11f9cac3d33 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:05.108733 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2fffad2a-4946-4e75-8122-d11f9cac3d33 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:05.119853 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-90e274ec-1e1f-4492-b79a-289c772e46e1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:05.121014 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-90e274ec-1e1f-4492-b79a-289c772e46e1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:05.129381 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-90e274ec-1e1f-4492-b79a-289c772e46e1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:05.130006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-90e274ec-1e1f-4492-b79a-289c772e46e1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:05.130729 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-90e274ec-1e1f-4492-b79a-289c772e46e1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:05.131624 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-90e274ec-1e1f-4492-b79a-289c772e46e1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:05.133341 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-90e274ec-1e1f-4492-b79a-289c772e46e1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:05.134600 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-90e274ec-1e1f-4492-b79a-289c772e46e1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:05.259739 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-2fffad2a-4946-4e75-8122-d11f9cac3d33 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:05.268097 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-2fffad2a-4946-4e75-8122-d11f9cac3d33 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.173711 Oct 14 13:05:05.268866 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 307/618] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:05 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:05.273215 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-de33e458-1054-4a05-910f-7b345c7df465 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:05.273722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-de33e458-1054-4a05-910f-7b345c7df465 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:05.279376 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-de33e458-1054-4a05-910f-7b345c7df465 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:05.279854 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-de33e458-1054-4a05-910f-7b345c7df465 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:05.280282 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-de33e458-1054-4a05-910f-7b345c7df465 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:05.281003 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-de33e458-1054-4a05-910f-7b345c7df465 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:05.281446 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-de33e458-1054-4a05-910f-7b345c7df465 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:05.281991 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-de33e458-1054-4a05-910f-7b345c7df465 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:05.311345 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-de33e458-1054-4a05-910f-7b345c7df465 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments/b4b990d6-60d8-49c6-a113-f10f74aef659" status: 200 len: 194 microversion: 2.1 time: 0.041477 Oct 14 13:05:05.311942 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 308/619] 10.222.0.47 () {58 vars in 1413 bytes} [Fri Oct 14 13:05:05 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments/b4b990d6-60d8-49c6-a113-f10f74aef659 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:05.324711 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ae250dad-0139-41a7-983b-5b4d5ad5b669 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:05.325678 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ae250dad-0139-41a7-983b-5b4d5ad5b669 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:05.331920 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ae250dad-0139-41a7-983b-5b4d5ad5b669 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:05.332498 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ae250dad-0139-41a7-983b-5b4d5ad5b669 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:05.333014 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ae250dad-0139-41a7-983b-5b4d5ad5b669 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:05.333810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ae250dad-0139-41a7-983b-5b4d5ad5b669 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:05.334752 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ae250dad-0139-41a7-983b-5b4d5ad5b669 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:05.335213 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ae250dad-0139-41a7-983b-5b4d5ad5b669 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:05.352920 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-90e274ec-1e1f-4492-b79a-289c772e46e1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:05.362899 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-90e274ec-1e1f-4492-b79a-289c772e46e1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:05.364674 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-90e274ec-1e1f-4492-b79a-289c772e46e1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:05.366261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-90e274ec-1e1f-4492-b79a-289c772e46e1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.250449 Oct 14 13:05:05.367038 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 312/620] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:05 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:05.425178 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-ae250dad-0139-41a7-983b-5b4d5ad5b669 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lazy-loading 'services' on Instance uuid 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:05:05.504655 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ae250dad-0139-41a7-983b-5b4d5ad5b669 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments/b4b990d6-60d8-49c6-a113-f10f74aef659" status: 202 len: 0 microversion: 2.1 time: 0.185363 Oct 14 13:05:05.505314 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 309/621] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Oct 14 13:05:05 2022] DELETE /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments/b4b990d6-60d8-49c6-a113-f10f74aef659 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:05:06.291760 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-37dc29ca-5d54-44f2-ae6b-02dd4ea0f557 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:06.292294 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-37dc29ca-5d54-44f2-ae6b-02dd4ea0f557 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:06.298640 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-37dc29ca-5d54-44f2-ae6b-02dd4ea0f557 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:06.299119 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-37dc29ca-5d54-44f2-ae6b-02dd4ea0f557 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:06.299546 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-37dc29ca-5d54-44f2-ae6b-02dd4ea0f557 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:06.300223 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-37dc29ca-5d54-44f2-ae6b-02dd4ea0f557 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:06.300673 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-37dc29ca-5d54-44f2-ae6b-02dd4ea0f557 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:06.301094 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-37dc29ca-5d54-44f2-ae6b-02dd4ea0f557 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:06.393366 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7d07e586-c737-4077-8952-24577e0e9306 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:06.394207 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7d07e586-c737-4077-8952-24577e0e9306 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:06.400380 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7d07e586-c737-4077-8952-24577e0e9306 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:06.400935 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7d07e586-c737-4077-8952-24577e0e9306 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:06.401444 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7d07e586-c737-4077-8952-24577e0e9306 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:06.402215 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7d07e586-c737-4077-8952-24577e0e9306 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:06.402731 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7d07e586-c737-4077-8952-24577e0e9306 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:06.403215 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7d07e586-c737-4077-8952-24577e0e9306 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:06.421743 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:06.431438 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-37dc29ca-5d54-44f2-ae6b-02dd4ea0f557 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:06.440029 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-37dc29ca-5d54-44f2-ae6b-02dd4ea0f557 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.152179 Oct 14 13:05:06.445857 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 313/622] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:06 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:06.541583 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7d07e586-c737-4077-8952-24577e0e9306 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:06.549851 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7d07e586-c737-4077-8952-24577e0e9306 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:06.551216 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7d07e586-c737-4077-8952-24577e0e9306 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:06.552356 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7d07e586-c737-4077-8952-24577e0e9306 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.163831 Oct 14 13:05:06.553145 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 310/623] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:06 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:05:07.463721 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c9847110-8398-4f19-a9cd-b8da0acbe015 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:07.464327 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c9847110-8398-4f19-a9cd-b8da0acbe015 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:07.470657 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c9847110-8398-4f19-a9cd-b8da0acbe015 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:07.471134 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c9847110-8398-4f19-a9cd-b8da0acbe015 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:07.471560 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c9847110-8398-4f19-a9cd-b8da0acbe015 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:07.472237 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c9847110-8398-4f19-a9cd-b8da0acbe015 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:07.472683 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c9847110-8398-4f19-a9cd-b8da0acbe015 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:07.473108 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c9847110-8398-4f19-a9cd-b8da0acbe015 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:07.578391 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ef8f0efb-b9b3-43c0-804c-cdda73a4458c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:07.579000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ef8f0efb-b9b3-43c0-804c-cdda73a4458c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:07.585711 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ef8f0efb-b9b3-43c0-804c-cdda73a4458c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:07.586130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ef8f0efb-b9b3-43c0-804c-cdda73a4458c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:07.586571 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ef8f0efb-b9b3-43c0-804c-cdda73a4458c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:07.587267 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ef8f0efb-b9b3-43c0-804c-cdda73a4458c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:07.587721 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ef8f0efb-b9b3-43c0-804c-cdda73a4458c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:07.588144 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ef8f0efb-b9b3-43c0-804c-cdda73a4458c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:07.605309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c9847110-8398-4f19-a9cd-b8da0acbe015 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:07.613373 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c9847110-8398-4f19-a9cd-b8da0acbe015 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.154034 Oct 14 13:05:07.614172 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 314/624] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:07 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:07.727720 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ef8f0efb-b9b3-43c0-804c-cdda73a4458c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:07.728047 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e9656055-a85e-46dc-8996-4e44f7b07c39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:07.728536 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e9656055-a85e-46dc-8996-4e44f7b07c39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:07.734373 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e9656055-a85e-46dc-8996-4e44f7b07c39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:07.735124 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e9656055-a85e-46dc-8996-4e44f7b07c39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:07.735552 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e9656055-a85e-46dc-8996-4e44f7b07c39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:07.736232 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e9656055-a85e-46dc-8996-4e44f7b07c39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:07.736346 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ef8f0efb-b9b3-43c0-804c-cdda73a4458c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:07.736678 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e9656055-a85e-46dc-8996-4e44f7b07c39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:07.737094 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e9656055-a85e-46dc-8996-4e44f7b07c39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:07.737760 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ef8f0efb-b9b3-43c0-804c-cdda73a4458c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:07.738903 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ef8f0efb-b9b3-43c0-804c-cdda73a4458c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.164446 Oct 14 13:05:07.739640 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 311/625] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:07 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:05:07.769949 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e9656055-a85e-46dc-8996-4e44f7b07c39 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments/29aaed04-8cb8-4219-b2b4-66d6ab97c754" status: 200 len: 194 microversion: 2.1 time: 0.045913 Oct 14 13:05:07.770523 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 315/626] 10.222.0.47 () {58 vars in 1413 bytes} [Fri Oct 14 13:05:07 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments/29aaed04-8cb8-4219-b2b4-66d6ab97c754 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:07.780941 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-db3fc7f6-5ee5-42df-8c89-54286e6945dc tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:07.781420 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-db3fc7f6-5ee5-42df-8c89-54286e6945dc tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:07.787250 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db3fc7f6-5ee5-42df-8c89-54286e6945dc tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:07.787727 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db3fc7f6-5ee5-42df-8c89-54286e6945dc tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:07.788158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db3fc7f6-5ee5-42df-8c89-54286e6945dc tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:07.788835 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db3fc7f6-5ee5-42df-8c89-54286e6945dc tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:07.789280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db3fc7f6-5ee5-42df-8c89-54286e6945dc tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:07.789745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db3fc7f6-5ee5-42df-8c89-54286e6945dc tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:07.872121 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-db3fc7f6-5ee5-42df-8c89-54286e6945dc tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lazy-loading 'services' on Instance uuid 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:05:07.952923 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-db3fc7f6-5ee5-42df-8c89-54286e6945dc tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments/29aaed04-8cb8-4219-b2b4-66d6ab97c754" status: 202 len: 0 microversion: 2.1 time: 0.175595 Oct 14 13:05:07.953605 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 312/627] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Oct 14 13:05:07 2022] DELETE /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments/29aaed04-8cb8-4219-b2b4-66d6ab97c754 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:05:08.636841 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-63fbeca5-302f-46cb-8ac6-5e2b0a969fbd tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:08.637445 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-63fbeca5-302f-46cb-8ac6-5e2b0a969fbd tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:08.639747 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=60 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:08.644926 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-63fbeca5-302f-46cb-8ac6-5e2b0a969fbd tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:08.645410 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-63fbeca5-302f-46cb-8ac6-5e2b0a969fbd tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:08.645872 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-63fbeca5-302f-46cb-8ac6-5e2b0a969fbd tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:08.646562 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-63fbeca5-302f-46cb-8ac6-5e2b0a969fbd tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:08.647018 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-63fbeca5-302f-46cb-8ac6-5e2b0a969fbd tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:08.647465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-63fbeca5-302f-46cb-8ac6-5e2b0a969fbd tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:08.765279 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-1b5b6965-7e6c-41e7-bb77-36820f7f5532 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:08.765995 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-1b5b6965-7e6c-41e7-bb77-36820f7f5532 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:08.771972 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1b5b6965-7e6c-41e7-bb77-36820f7f5532 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:08.772449 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1b5b6965-7e6c-41e7-bb77-36820f7f5532 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:08.772887 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1b5b6965-7e6c-41e7-bb77-36820f7f5532 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:08.773601 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1b5b6965-7e6c-41e7-bb77-36820f7f5532 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:08.774053 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1b5b6965-7e6c-41e7-bb77-36820f7f5532 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:08.774491 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1b5b6965-7e6c-41e7-bb77-36820f7f5532 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:08.775840 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-63fbeca5-302f-46cb-8ac6-5e2b0a969fbd tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:08.783675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-63fbeca5-302f-46cb-8ac6-5e2b0a969fbd tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.150764 Oct 14 13:05:08.784240 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 316/628] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:08 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:08.903087 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-1b5b6965-7e6c-41e7-bb77-36820f7f5532 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:08.911328 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-1b5b6965-7e6c-41e7-bb77-36820f7f5532 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:08.912770 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-1b5b6965-7e6c-41e7-bb77-36820f7f5532 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:08.913956 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-1b5b6965-7e6c-41e7-bb77-36820f7f5532 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.153459 Oct 14 13:05:08.914502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 313/629] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:08 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:05:09.807161 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-65016d93-d622-4334-b162-cdd87209e775 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:09.807775 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-65016d93-d622-4334-b162-cdd87209e775 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:09.814150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-65016d93-d622-4334-b162-cdd87209e775 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:09.814640 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-65016d93-d622-4334-b162-cdd87209e775 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:09.815081 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-65016d93-d622-4334-b162-cdd87209e775 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:09.815772 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-65016d93-d622-4334-b162-cdd87209e775 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:09.816229 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-65016d93-d622-4334-b162-cdd87209e775 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:09.816656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-65016d93-d622-4334-b162-cdd87209e775 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:09.939948 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-84d59571-828d-48e2-b895-abe479007de6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:09.940543 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-84d59571-828d-48e2-b895-abe479007de6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:09.946973 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-84d59571-828d-48e2-b895-abe479007de6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:09.947450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-84d59571-828d-48e2-b895-abe479007de6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:09.947879 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-84d59571-828d-48e2-b895-abe479007de6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:09.948564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-84d59571-828d-48e2-b895-abe479007de6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:09.949008 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-84d59571-828d-48e2-b895-abe479007de6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:09.949424 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-84d59571-828d-48e2-b895-abe479007de6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:09.949840 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-65016d93-d622-4334-b162-cdd87209e775 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:09.957890 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-65016d93-d622-4334-b162-cdd87209e775 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.154547 Oct 14 13:05:09.958462 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 317/630] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:09 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:05:10.083819 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-84d59571-828d-48e2-b895-abe479007de6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:10.092408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-84d59571-828d-48e2-b895-abe479007de6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:10.093971 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-84d59571-828d-48e2-b895-abe479007de6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:10.095115 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-84d59571-828d-48e2-b895-abe479007de6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.159014 Oct 14 13:05:10.095664 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 314/631] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:09 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:05:10.983386 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0d8fc712-cbb7-4024-83be-e8e36ab4a7b6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:10.983990 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0d8fc712-cbb7-4024-83be-e8e36ab4a7b6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:10.990876 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d8fc712-cbb7-4024-83be-e8e36ab4a7b6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:10.991358 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d8fc712-cbb7-4024-83be-e8e36ab4a7b6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:10.991786 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d8fc712-cbb7-4024-83be-e8e36ab4a7b6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:10.992467 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d8fc712-cbb7-4024-83be-e8e36ab4a7b6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:10.992955 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d8fc712-cbb7-4024-83be-e8e36ab4a7b6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:10.994127 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d8fc712-cbb7-4024-83be-e8e36ab4a7b6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:11.121260 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-9f249bcd-4b2f-4497-b699-0dbf3aef66f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:11.121888 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-9f249bcd-4b2f-4497-b699-0dbf3aef66f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:11.122275 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0d8fc712-cbb7-4024-83be-e8e36ab4a7b6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:11.128300 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9f249bcd-4b2f-4497-b699-0dbf3aef66f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:11.128786 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9f249bcd-4b2f-4497-b699-0dbf3aef66f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:11.129225 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9f249bcd-4b2f-4497-b699-0dbf3aef66f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:11.129944 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9f249bcd-4b2f-4497-b699-0dbf3aef66f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:11.130088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0d8fc712-cbb7-4024-83be-e8e36ab4a7b6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.150548 Oct 14 13:05:11.130395 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9f249bcd-4b2f-4497-b699-0dbf3aef66f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:11.130659 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 318/632] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:10 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:11.130817 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9f249bcd-4b2f-4497-b699-0dbf3aef66f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:11.257177 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-9f249bcd-4b2f-4497-b699-0dbf3aef66f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:11.265166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-9f249bcd-4b2f-4497-b699-0dbf3aef66f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:11.266695 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-9f249bcd-4b2f-4497-b699-0dbf3aef66f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:11.267843 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-9f249bcd-4b2f-4497-b699-0dbf3aef66f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.151122 Oct 14 13:05:11.268405 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 315/633] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:11 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:05:12.152294 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1a478d6c-0cd2-4b35-a395-41a88510bb89 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:12.152833 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1a478d6c-0cd2-4b35-a395-41a88510bb89 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:12.159310 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1a478d6c-0cd2-4b35-a395-41a88510bb89 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:12.159803 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1a478d6c-0cd2-4b35-a395-41a88510bb89 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:12.160233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1a478d6c-0cd2-4b35-a395-41a88510bb89 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:12.160923 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1a478d6c-0cd2-4b35-a395-41a88510bb89 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:12.161378 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1a478d6c-0cd2-4b35-a395-41a88510bb89 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:12.161832 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1a478d6c-0cd2-4b35-a395-41a88510bb89 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:12.291266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-1a478d6c-0cd2-4b35-a395-41a88510bb89 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:12.292981 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8df9d13d-6450-4d6d-8d3b-100bcdd07c2e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:12.293619 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8df9d13d-6450-4d6d-8d3b-100bcdd07c2e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:12.299394 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1a478d6c-0cd2-4b35-a395-41a88510bb89 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.151082 Oct 14 13:05:12.299911 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8df9d13d-6450-4d6d-8d3b-100bcdd07c2e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:12.300352 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 319/634] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:12 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:12.300469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8df9d13d-6450-4d6d-8d3b-100bcdd07c2e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:12.300803 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8df9d13d-6450-4d6d-8d3b-100bcdd07c2e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:12.301508 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8df9d13d-6450-4d6d-8d3b-100bcdd07c2e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:12.301956 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8df9d13d-6450-4d6d-8d3b-100bcdd07c2e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:12.302372 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8df9d13d-6450-4d6d-8d3b-100bcdd07c2e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:12.427453 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8df9d13d-6450-4d6d-8d3b-100bcdd07c2e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:12.436003 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8df9d13d-6450-4d6d-8d3b-100bcdd07c2e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:12.437435 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8df9d13d-6450-4d6d-8d3b-100bcdd07c2e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:12.438633 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8df9d13d-6450-4d6d-8d3b-100bcdd07c2e tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.149463 Oct 14 13:05:12.439178 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 316/635] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:12 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:13.323777 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-8c2847d7-be0c-4c5c-a6c7-4f3a99af4e1e tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:13.324489 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-8c2847d7-be0c-4c5c-a6c7-4f3a99af4e1e tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:13.331376 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8c2847d7-be0c-4c5c-a6c7-4f3a99af4e1e tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:13.331933 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8c2847d7-be0c-4c5c-a6c7-4f3a99af4e1e tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:13.332452 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8c2847d7-be0c-4c5c-a6c7-4f3a99af4e1e tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:13.333415 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8c2847d7-be0c-4c5c-a6c7-4f3a99af4e1e tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:13.334069 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8c2847d7-be0c-4c5c-a6c7-4f3a99af4e1e tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:13.334487 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8c2847d7-be0c-4c5c-a6c7-4f3a99af4e1e tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:13.464892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-33cf4bb6-dcb0-4e9a-ae64-b1e57ca9eacc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:13.465809 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-33cf4bb6-dcb0-4e9a-ae64-b1e57ca9eacc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:13.473375 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-33cf4bb6-dcb0-4e9a-ae64-b1e57ca9eacc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:13.473980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-33cf4bb6-dcb0-4e9a-ae64-b1e57ca9eacc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:13.474357 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-8c2847d7-be0c-4c5c-a6c7-4f3a99af4e1e tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:13.474543 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-33cf4bb6-dcb0-4e9a-ae64-b1e57ca9eacc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:13.475309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-33cf4bb6-dcb0-4e9a-ae64-b1e57ca9eacc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:13.475837 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-33cf4bb6-dcb0-4e9a-ae64-b1e57ca9eacc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:13.476328 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-33cf4bb6-dcb0-4e9a-ae64-b1e57ca9eacc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:13.482550 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-8c2847d7-be0c-4c5c-a6c7-4f3a99af4e1e tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.163120 Oct 14 13:05:13.483049 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 320/636] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:13 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:05:13.608080 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-33cf4bb6-dcb0-4e9a-ae64-b1e57ca9eacc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:13.616462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-33cf4bb6-dcb0-4e9a-ae64-b1e57ca9eacc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:13.617960 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-33cf4bb6-dcb0-4e9a-ae64-b1e57ca9eacc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:13.619102 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-33cf4bb6-dcb0-4e9a-ae64-b1e57ca9eacc tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1746 microversion: 2.20 time: 0.159718 Oct 14 13:05:13.619652 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 317/637] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:13 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:14.432422 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-3e4986f5-5bdd-4bad-8182-681448ad6103 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:14.434659 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-3e4986f5-5bdd-4bad-8182-681448ad6103 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:14.440764 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e4986f5-5bdd-4bad-8182-681448ad6103 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:14.441251 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e4986f5-5bdd-4bad-8182-681448ad6103 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:14.441716 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e4986f5-5bdd-4bad-8182-681448ad6103 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:14.442413 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e4986f5-5bdd-4bad-8182-681448ad6103 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:14.442870 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e4986f5-5bdd-4bad-8182-681448ad6103 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:14.443302 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3e4986f5-5bdd-4bad-8182-681448ad6103 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:14.468926 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=100 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:14.473203 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-3e4986f5-5bdd-4bad-8182-681448ad6103 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045373 Oct 14 13:05:14.473800 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 321/638] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:05:14 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 13:05:14.509095 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-9bb2ad1e-e3dd-4f9b-af94-e66311b580c2 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:14.510307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-9bb2ad1e-e3dd-4f9b-af94-e66311b580c2 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:14.516722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9bb2ad1e-e3dd-4f9b-af94-e66311b580c2 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:14.517207 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9bb2ad1e-e3dd-4f9b-af94-e66311b580c2 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:14.517848 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9bb2ad1e-e3dd-4f9b-af94-e66311b580c2 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:14.518542 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9bb2ad1e-e3dd-4f9b-af94-e66311b580c2 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:14.518992 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9bb2ad1e-e3dd-4f9b-af94-e66311b580c2 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:14.519584 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9bb2ad1e-e3dd-4f9b-af94-e66311b580c2 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:14.603609 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1bbf6ba7-b8c0-4df4-a7c0-4dbec330576d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:14.605755 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1bbf6ba7-b8c0-4df4-a7c0-4dbec330576d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:14.612541 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1bbf6ba7-b8c0-4df4-a7c0-4dbec330576d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:14.613213 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1bbf6ba7-b8c0-4df4-a7c0-4dbec330576d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:14.613849 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1bbf6ba7-b8c0-4df4-a7c0-4dbec330576d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:14.614693 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1bbf6ba7-b8c0-4df4-a7c0-4dbec330576d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:14.615320 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1bbf6ba7-b8c0-4df4-a7c0-4dbec330576d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:14.615896 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1bbf6ba7-b8c0-4df4-a7c0-4dbec330576d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:14.650632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1bbf6ba7-b8c0-4df4-a7c0-4dbec330576d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051779 Oct 14 13:05:14.651199 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 322/639] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:05:14 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 14 13:05:14.655642 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-809a7749-2aa9-4175-b01e-2f827d23cd03 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:14.656431 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-809a7749-2aa9-4175-b01e-2f827d23cd03 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:14.663327 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-9bb2ad1e-e3dd-4f9b-af94-e66311b580c2 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:14.666132 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-809a7749-2aa9-4175-b01e-2f827d23cd03 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:14.666736 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-809a7749-2aa9-4175-b01e-2f827d23cd03 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:14.669221 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-809a7749-2aa9-4175-b01e-2f827d23cd03 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:14.670307 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-809a7749-2aa9-4175-b01e-2f827d23cd03 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:14.671259 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-809a7749-2aa9-4175-b01e-2f827d23cd03 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:14.671796 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-809a7749-2aa9-4175-b01e-2f827d23cd03 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:14.675163 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-9bb2ad1e-e3dd-4f9b-af94-e66311b580c2 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.171824 Oct 14 13:05:14.677806 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 318/640] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:14 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:14.723690 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ce96decc-a118-4e64-b27e-1375b5fe552f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:14.724164 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ce96decc-a118-4e64-b27e-1375b5fe552f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:14.730429 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ce96decc-a118-4e64-b27e-1375b5fe552f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:14.730917 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ce96decc-a118-4e64-b27e-1375b5fe552f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:14.731354 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ce96decc-a118-4e64-b27e-1375b5fe552f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:14.732060 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ce96decc-a118-4e64-b27e-1375b5fe552f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:14.732514 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ce96decc-a118-4e64-b27e-1375b5fe552f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:14.732943 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ce96decc-a118-4e64-b27e-1375b5fe552f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:14.760177 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ce96decc-a118-4e64-b27e-1375b5fe552f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Going to try to terminate instance {{(pid=118869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:05:14.812167 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-809a7749-2aa9-4175-b01e-2f827d23cd03 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:14.821815 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-809a7749-2aa9-4175-b01e-2f827d23cd03 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:14.824065 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-809a7749-2aa9-4175-b01e-2f827d23cd03 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:14.825571 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-809a7749-2aa9-4175-b01e-2f827d23cd03 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1746 microversion: 2.20 time: 0.173406 Oct 14 13:05:14.826322 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 323/641] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:14 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1746 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:14.843021 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ce96decc-a118-4e64-b27e-1375b5fe552f tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 204 len: 0 microversion: 2.1 time: 0.123435 Oct 14 13:05:14.844076 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 319/642] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:05:14 2022] DELETE /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 14 13:05:14.852031 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f881f000-d1ef-457b-91cd-156d27000c15 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:14.852811 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-f881f000-d1ef-457b-91cd-156d27000c15 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:14.858741 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f881f000-d1ef-457b-91cd-156d27000c15 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:14.859228 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f881f000-d1ef-457b-91cd-156d27000c15 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:14.859967 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f881f000-d1ef-457b-91cd-156d27000c15 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:14.860660 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f881f000-d1ef-457b-91cd-156d27000c15 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:14.861110 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f881f000-d1ef-457b-91cd-156d27000c15 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:14.861574 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f881f000-d1ef-457b-91cd-156d27000c15 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:14.998339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f881f000-d1ef-457b-91cd-156d27000c15 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:15.006296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f881f000-d1ef-457b-91cd-156d27000c15 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1674 microversion: 2.1 time: 0.158214 Oct 14 13:05:15.006880 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 324/643] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:14 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:05:15.701814 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e4eeec2e-263c-4087-bed2-bcf38739fd00 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:15.702501 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e4eeec2e-263c-4087-bed2-bcf38739fd00 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:15.709040 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e4eeec2e-263c-4087-bed2-bcf38739fd00 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:15.709575 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e4eeec2e-263c-4087-bed2-bcf38739fd00 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:15.709996 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e4eeec2e-263c-4087-bed2-bcf38739fd00 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:15.710689 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e4eeec2e-263c-4087-bed2-bcf38739fd00 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:15.711168 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e4eeec2e-263c-4087-bed2-bcf38739fd00 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:15.711590 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e4eeec2e-263c-4087-bed2-bcf38739fd00 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:15.852928 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9a13bb8f-36c1-4729-8956-af0050da4ecb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:15.854137 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-9a13bb8f-36c1-4729-8956-af0050da4ecb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:15.862157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9a13bb8f-36c1-4729-8956-af0050da4ecb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:15.862845 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9a13bb8f-36c1-4729-8956-af0050da4ecb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:15.863450 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9a13bb8f-36c1-4729-8956-af0050da4ecb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:15.864316 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9a13bb8f-36c1-4729-8956-af0050da4ecb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:15.865054 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9a13bb8f-36c1-4729-8956-af0050da4ecb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:15.865667 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9a13bb8f-36c1-4729-8956-af0050da4ecb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:15.866248 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e4eeec2e-263c-4087-bed2-bcf38739fd00 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:15.882577 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e4eeec2e-263c-4087-bed2-bcf38739fd00 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.184936 Oct 14 13:05:15.883161 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 320/644] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:15 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:15.994664 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-7cadf1c8-8e03-42e2-bb9f-5656d7fa5be2 req-c5f2d4ab-aa37-4146-9704-fb9aa8025363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bff20a0-76b8-44e6-9f5c-87a9fce18f87", "name": "network-vif-plugged", "status": "completed", "tag": "096cc001-9ca8-472a-8f3d-2a345a805218"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:05:16.005838 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-7cadf1c8-8e03-42e2-bb9f-5656d7fa5be2 req-c5f2d4ab-aa37-4146-9704-fb9aa8025363 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:16.006706 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-7cadf1c8-8e03-42e2-bb9f-5656d7fa5be2 req-c5f2d4ab-aa37-4146-9704-fb9aa8025363 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:16.007415 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-7cadf1c8-8e03-42e2-bb9f-5656d7fa5be2 req-c5f2d4ab-aa37-4146-9704-fb9aa8025363 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:16.019651 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-7cadf1c8-8e03-42e2-bb9f-5656d7fa5be2 req-c5f2d4ab-aa37-4146-9704-fb9aa8025363 service nova] Creating event network-vif-plugged:096cc001-9ca8-472a-8f3d-2a345a805218 for instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 on hv-cinder-82099 Oct 14 13:05:16.026607 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-7cadf1c8-8e03-42e2-bb9f-5656d7fa5be2 req-c5f2d4ab-aa37-4146-9704-fb9aa8025363 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052339 Oct 14 13:05:16.029188 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 321/645] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:16.038626 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f6e00d96-073d-4b1e-9645-603adf60fba3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:16.039540 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f6e00d96-073d-4b1e-9645-603adf60fba3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:16.047093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f6e00d96-073d-4b1e-9645-603adf60fba3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:16.047862 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f6e00d96-073d-4b1e-9645-603adf60fba3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:16.048524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f6e00d96-073d-4b1e-9645-603adf60fba3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:16.049296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f6e00d96-073d-4b1e-9645-603adf60fba3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:16.049920 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f6e00d96-073d-4b1e-9645-603adf60fba3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:16.050502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f6e00d96-073d-4b1e-9645-603adf60fba3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:16.068054 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9a13bb8f-36c1-4729-8956-af0050da4ecb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:16.079208 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9a13bb8f-36c1-4729-8956-af0050da4ecb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:16.081502 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9a13bb8f-36c1-4729-8956-af0050da4ecb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:16.082781 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-9a13bb8f-36c1-4729-8956-af0050da4ecb tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1746 microversion: 2.20 time: 0.234506 Oct 14 13:05:16.097506 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 325/646] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:15 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1746 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:16.216987 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f6e00d96-073d-4b1e-9645-603adf60fba3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:16.224877 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-f6e00d96-073d-4b1e-9645-603adf60fba3 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1674 microversion: 2.1 time: 0.191210 Oct 14 13:05:16.225434 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 322/647] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:16 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:16.905255 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d9719ff1-6d5e-4792-a6ec-e59d00557df7 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:16.905884 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-d9719ff1-6d5e-4792-a6ec-e59d00557df7 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:16.912243 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d9719ff1-6d5e-4792-a6ec-e59d00557df7 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:16.912721 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d9719ff1-6d5e-4792-a6ec-e59d00557df7 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:16.913147 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d9719ff1-6d5e-4792-a6ec-e59d00557df7 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:16.913856 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d9719ff1-6d5e-4792-a6ec-e59d00557df7 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:16.914306 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d9719ff1-6d5e-4792-a6ec-e59d00557df7 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:16.915231 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d9719ff1-6d5e-4792-a6ec-e59d00557df7 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:17.108949 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-61f9ee36-9459-4ef9-84c2-51863d25880d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:17.109947 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-61f9ee36-9459-4ef9-84c2-51863d25880d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:17.116427 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-61f9ee36-9459-4ef9-84c2-51863d25880d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:17.116991 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-61f9ee36-9459-4ef9-84c2-51863d25880d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:17.117424 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-61f9ee36-9459-4ef9-84c2-51863d25880d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:17.118688 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-61f9ee36-9459-4ef9-84c2-51863d25880d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:17.119132 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-61f9ee36-9459-4ef9-84c2-51863d25880d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:17.119549 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-61f9ee36-9459-4ef9-84c2-51863d25880d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:17.277760 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-61f9ee36-9459-4ef9-84c2-51863d25880d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:17.287456 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-61f9ee36-9459-4ef9-84c2-51863d25880d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:17.289036 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-61f9ee36-9459-4ef9-84c2-51863d25880d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:17.291898 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-61f9ee36-9459-4ef9-84c2-51863d25880d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1746 microversion: 2.20 time: 0.186914 Oct 14 13:05:17.292969 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 323/648] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:17 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1746 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:05:17.298609 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e0659fd7-b0f6-4370-8194-2bc294ecc190 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:17.299490 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e0659fd7-b0f6-4370-8194-2bc294ecc190 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:17.306900 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e0659fd7-b0f6-4370-8194-2bc294ecc190 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:17.307638 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e0659fd7-b0f6-4370-8194-2bc294ecc190 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:17.308231 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e0659fd7-b0f6-4370-8194-2bc294ecc190 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:17.309235 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e0659fd7-b0f6-4370-8194-2bc294ecc190 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:17.309883 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e0659fd7-b0f6-4370-8194-2bc294ecc190 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:17.310312 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e0659fd7-b0f6-4370-8194-2bc294ecc190 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:17.316823 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-d9719ff1-6d5e-4792-a6ec-e59d00557df7 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:17.326227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-d9719ff1-6d5e-4792-a6ec-e59d00557df7 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.424871 Oct 14 13:05:17.327035 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 326/649] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:16 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1575 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:17.473347 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e0659fd7-b0f6-4370-8194-2bc294ecc190 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:17.489388 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e0659fd7-b0f6-4370-8194-2bc294ecc190 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1674 microversion: 2.1 time: 0.194744 Oct 14 13:05:17.490905 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 324/650] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:17 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1674 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:18.115605 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-4dc3f23b-998f-4458-b479-145be5c401b7 req-75ef76a4-c584-4e99-af20-d1fe23dc0847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f", "name": "network-vif-plugged", "status": "completed", "tag": "5974c9e5-7b5e-4f03-aaed-db90e7d7a18e"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:05:18.129277 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-4dc3f23b-998f-4458-b479-145be5c401b7 req-75ef76a4-c584-4e99-af20-d1fe23dc0847 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:18.130648 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-4dc3f23b-998f-4458-b479-145be5c401b7 req-75ef76a4-c584-4e99-af20-d1fe23dc0847 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:18.131240 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-4dc3f23b-998f-4458-b479-145be5c401b7 req-75ef76a4-c584-4e99-af20-d1fe23dc0847 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:18.146326 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-4dc3f23b-998f-4458-b479-145be5c401b7 req-75ef76a4-c584-4e99-af20-d1fe23dc0847 service nova] Creating event network-vif-plugged:5974c9e5-7b5e-4f03-aaed-db90e7d7a18e for instance 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f on hv-cinder-82099 Oct 14 13:05:18.152360 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-4dc3f23b-998f-4458-b479-145be5c401b7 req-75ef76a4-c584-4e99-af20-d1fe23dc0847 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110210 Oct 14 13:05:18.153438 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 327/651] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:18.317736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-b716d7ba-e7f4-42a4-ae24-df67886c2a99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:18.319674 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-b716d7ba-e7f4-42a4-ae24-df67886c2a99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:18.337932 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b716d7ba-e7f4-42a4-ae24-df67886c2a99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:18.339018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b716d7ba-e7f4-42a4-ae24-df67886c2a99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:18.339704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b716d7ba-e7f4-42a4-ae24-df67886c2a99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:18.341177 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b716d7ba-e7f4-42a4-ae24-df67886c2a99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:18.343265 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b716d7ba-e7f4-42a4-ae24-df67886c2a99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:18.356064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-748c897a-7bfa-49b7-8c14-329d1d673146 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:18.357906 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-748c897a-7bfa-49b7-8c14-329d1d673146 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:18.361087 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b716d7ba-e7f4-42a4-ae24-df67886c2a99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:18.382037 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-748c897a-7bfa-49b7-8c14-329d1d673146 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:18.382655 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-748c897a-7bfa-49b7-8c14-329d1d673146 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:18.385305 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-748c897a-7bfa-49b7-8c14-329d1d673146 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:18.386864 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-748c897a-7bfa-49b7-8c14-329d1d673146 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:18.389644 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-748c897a-7bfa-49b7-8c14-329d1d673146 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:18.390146 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-748c897a-7bfa-49b7-8c14-329d1d673146 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:18.439750 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:18.742328 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-b716d7ba-e7f4-42a4-ae24-df67886c2a99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:18.744606 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-748c897a-7bfa-49b7-8c14-329d1d673146 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:18.751946 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-b716d7ba-e7f4-42a4-ae24-df67886c2a99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:18.753411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-b716d7ba-e7f4-42a4-ae24-df67886c2a99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:18.754615 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-b716d7ba-e7f4-42a4-ae24-df67886c2a99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1741 microversion: 2.20 time: 0.441047 Oct 14 13:05:18.755282 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-748c897a-7bfa-49b7-8c14-329d1d673146 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.405210 Oct 14 13:05:18.756543 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 328/652] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:18 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1575 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:18.758865 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 325/653] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:18 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1741 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:18.771280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2d106610-0f51-4be7-98e0-61b7459f668d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:18.774755 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-2d106610-0f51-4be7-98e0-61b7459f668d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:18.787621 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2d106610-0f51-4be7-98e0-61b7459f668d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:18.790584 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2d106610-0f51-4be7-98e0-61b7459f668d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:18.792521 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2d106610-0f51-4be7-98e0-61b7459f668d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:18.793252 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2d106610-0f51-4be7-98e0-61b7459f668d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:18.798342 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2d106610-0f51-4be7-98e0-61b7459f668d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:18.798342 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2d106610-0f51-4be7-98e0-61b7459f668d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:18.844097 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2d106610-0f51-4be7-98e0-61b7459f668d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:18.844873 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2d106610-0f51-4be7-98e0-61b7459f668d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:18.845590 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2d106610-0f51-4be7-98e0-61b7459f668d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:18.846208 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-2d106610-0f51-4be7-98e0-61b7459f668d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lazy-loading 'fault' on Instance uuid 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:05:18.875223 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-c8f38672-2caa-48d5-ae87-b1f59f43b13f req-1a213978-c655-48c7-9791-5448542f7084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad4b0b2-2eb5-4754-89fc-8fab97ffd780", "name": "network-vif-deleted", "tag": "80cb034b-1583-4a34-a888-d6a5a94739ed"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:05:18.905185 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-c8f38672-2caa-48d5-ae87-b1f59f43b13f req-1a213978-c655-48c7-9791-5448542f7084 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:18.906020 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-c8f38672-2caa-48d5-ae87-b1f59f43b13f req-1a213978-c655-48c7-9791-5448542f7084 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:18.907277 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-c8f38672-2caa-48d5-ae87-b1f59f43b13f req-1a213978-c655-48c7-9791-5448542f7084 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:18.909931 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-2d106610-0f51-4be7-98e0-61b7459f668d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:18.918930 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-2d106610-0f51-4be7-98e0-61b7459f668d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1328 microversion: 2.1 time: 0.155261 Oct 14 13:05:18.926275 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-c8f38672-2caa-48d5-ae87-b1f59f43b13f req-1a213978-c655-48c7-9791-5448542f7084 service nova] Creating event network-vif-deleted:80cb034b-1583-4a34-a888-d6a5a94739ed for instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 on hv-cinder-82099 Oct 14 13:05:18.933902 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 326/654] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:18 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1328 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:18.935731 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-c8f38672-2caa-48d5-ae87-b1f59f43b13f req-1a213978-c655-48c7-9791-5448542f7084 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177420 Oct 14 13:05:18.937008 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 329/655] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:19.780219 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5cd4f7fa-9574-4a7a-8c90-f7d0a38e2c98 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:19.780762 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5cd4f7fa-9574-4a7a-8c90-f7d0a38e2c98 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:19.783295 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-25516ff7-7c5d-4c79-8968-8c067422afff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:19.784126 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-25516ff7-7c5d-4c79-8968-8c067422afff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:19.788666 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:19.790768 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5cd4f7fa-9574-4a7a-8c90-f7d0a38e2c98 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:19.791275 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5cd4f7fa-9574-4a7a-8c90-f7d0a38e2c98 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:19.791712 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5cd4f7fa-9574-4a7a-8c90-f7d0a38e2c98 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:19.792417 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5cd4f7fa-9574-4a7a-8c90-f7d0a38e2c98 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:19.792587 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25516ff7-7c5d-4c79-8968-8c067422afff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:19.793039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25516ff7-7c5d-4c79-8968-8c067422afff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:19.793377 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5cd4f7fa-9574-4a7a-8c90-f7d0a38e2c98 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:19.793645 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25516ff7-7c5d-4c79-8968-8c067422afff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:19.794167 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5cd4f7fa-9574-4a7a-8c90-f7d0a38e2c98 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:19.794467 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25516ff7-7c5d-4c79-8968-8c067422afff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:19.794974 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25516ff7-7c5d-4c79-8968-8c067422afff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:19.795615 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25516ff7-7c5d-4c79-8968-8c067422afff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:19.949526 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-25516ff7-7c5d-4c79-8968-8c067422afff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:19.960142 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-25516ff7-7c5d-4c79-8968-8c067422afff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:19.961966 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-25516ff7-7c5d-4c79-8968-8c067422afff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:19.963712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-25516ff7-7c5d-4c79-8968-8c067422afff tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1741 microversion: 2.20 time: 0.184952 Oct 14 13:05:19.978424 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 330/656] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:19 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1741 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:05:19.985380 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-5cd4f7fa-9574-4a7a-8c90-f7d0a38e2c98 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:19.991708 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-637f1f5d-ed01-4412-a09f-9aace42d0556 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:19.992540 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-637f1f5d-ed01-4412-a09f-9aace42d0556 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:19.994948 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5cd4f7fa-9574-4a7a-8c90-f7d0a38e2c98 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.218814 Oct 14 13:05:19.996157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 327/657] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:19 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:19.999439 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-637f1f5d-ed01-4412-a09f-9aace42d0556 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:19.999935 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-637f1f5d-ed01-4412-a09f-9aace42d0556 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:20.000372 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-637f1f5d-ed01-4412-a09f-9aace42d0556 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:20.001077 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-637f1f5d-ed01-4412-a09f-9aace42d0556 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:20.001566 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-637f1f5d-ed01-4412-a09f-9aace42d0556 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:20.001996 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-637f1f5d-ed01-4412-a09f-9aace42d0556 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:20.041232 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-637f1f5d-ed01-4412-a09f-9aace42d0556 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:20.041764 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-637f1f5d-ed01-4412-a09f-9aace42d0556 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:20.042213 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-637f1f5d-ed01-4412-a09f-9aace42d0556 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:20.042661 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.objects.instance [None req-637f1f5d-ed01-4412-a09f-9aace42d0556 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lazy-loading 'fault' on Instance uuid 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 {{(pid=118868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:05:20.091425 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-637f1f5d-ed01-4412-a09f-9aace42d0556 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:20.099617 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-637f1f5d-ed01-4412-a09f-9aace42d0556 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1328 microversion: 2.1 time: 0.119816 Oct 14 13:05:20.100423 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 331/658] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:19 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:20.992296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-fccc3eca-91e4-4ccb-9cc7-ea3bfb3ae8b7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:20.993991 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-fccc3eca-91e4-4ccb-9cc7-ea3bfb3ae8b7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:21.000789 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fccc3eca-91e4-4ccb-9cc7-ea3bfb3ae8b7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:21.001265 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fccc3eca-91e4-4ccb-9cc7-ea3bfb3ae8b7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:21.001725 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fccc3eca-91e4-4ccb-9cc7-ea3bfb3ae8b7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:21.002406 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fccc3eca-91e4-4ccb-9cc7-ea3bfb3ae8b7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:21.002853 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fccc3eca-91e4-4ccb-9cc7-ea3bfb3ae8b7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:21.003266 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fccc3eca-91e4-4ccb-9cc7-ea3bfb3ae8b7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:21.023665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5ef67113-85a3-440a-82f0-3d0bc6cc233b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:21.025270 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5ef67113-85a3-440a-82f0-3d0bc6cc233b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:21.032213 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ef67113-85a3-440a-82f0-3d0bc6cc233b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:21.033204 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ef67113-85a3-440a-82f0-3d0bc6cc233b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:21.033886 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ef67113-85a3-440a-82f0-3d0bc6cc233b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:21.035215 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ef67113-85a3-440a-82f0-3d0bc6cc233b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:21.035908 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ef67113-85a3-440a-82f0-3d0bc6cc233b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:21.036565 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ef67113-85a3-440a-82f0-3d0bc6cc233b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:21.151007 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-fccc3eca-91e4-4ccb-9cc7-ea3bfb3ae8b7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:21.160066 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-fccc3eca-91e4-4ccb-9cc7-ea3bfb3ae8b7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:21.161849 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-fccc3eca-91e4-4ccb-9cc7-ea3bfb3ae8b7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:21.163239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-fccc3eca-91e4-4ccb-9cc7-ea3bfb3ae8b7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1741 microversion: 2.20 time: 0.174883 Oct 14 13:05:21.164356 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 328/659] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:20 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:21.173131 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0a1dfaf4-542f-494a-8d9f-0bb5103c7d68 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:21.173998 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-0a1dfaf4-542f-494a-8d9f-0bb5103c7d68 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:21.204246 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0a1dfaf4-542f-494a-8d9f-0bb5103c7d68 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:21.204246 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0a1dfaf4-542f-494a-8d9f-0bb5103c7d68 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:21.204246 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0a1dfaf4-542f-494a-8d9f-0bb5103c7d68 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:21.204665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5ef67113-85a3-440a-82f0-3d0bc6cc233b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:21.204786 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0a1dfaf4-542f-494a-8d9f-0bb5103c7d68 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:21.204786 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0a1dfaf4-542f-494a-8d9f-0bb5103c7d68 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:21.204786 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0a1dfaf4-542f-494a-8d9f-0bb5103c7d68 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:21.211320 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5ef67113-85a3-440a-82f0-3d0bc6cc233b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.192019 Oct 14 13:05:21.213628 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 332/660] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:21 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1575 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:05:21.240095 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0a1dfaf4-542f-494a-8d9f-0bb5103c7d68 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:21.240611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0a1dfaf4-542f-494a-8d9f-0bb5103c7d68 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:21.241265 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0a1dfaf4-542f-494a-8d9f-0bb5103c7d68 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:21.241747 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-0a1dfaf4-542f-494a-8d9f-0bb5103c7d68 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lazy-loading 'fault' on Instance uuid 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:05:21.288846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-0a1dfaf4-542f-494a-8d9f-0bb5103c7d68 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9394667740f44bcab24ee484b195fe96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9247e549c63f4a42be20f5a7aeda0594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:21.298034 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-0a1dfaf4-542f-494a-8d9f-0bb5103c7d68 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 200 len: 1328 microversion: 2.1 time: 0.132428 Oct 14 13:05:21.298614 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 329/661] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:21 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 1328 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:22.198743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5caa628b-3759-4cfc-80e9-20a140fa030f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:22.199668 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5caa628b-3759-4cfc-80e9-20a140fa030f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:22.207312 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5caa628b-3759-4cfc-80e9-20a140fa030f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:22.208147 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5caa628b-3759-4cfc-80e9-20a140fa030f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:22.208767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5caa628b-3759-4cfc-80e9-20a140fa030f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:22.209951 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5caa628b-3759-4cfc-80e9-20a140fa030f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:22.211030 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5caa628b-3759-4cfc-80e9-20a140fa030f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:22.212265 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5caa628b-3759-4cfc-80e9-20a140fa030f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:22.242832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-1bb8fb50-4506-412d-a9ad-173d52e3d831 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:22.243483 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-1bb8fb50-4506-412d-a9ad-173d52e3d831 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:22.253667 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1bb8fb50-4506-412d-a9ad-173d52e3d831 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:22.254169 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1bb8fb50-4506-412d-a9ad-173d52e3d831 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:22.254615 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1bb8fb50-4506-412d-a9ad-173d52e3d831 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:22.255495 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1bb8fb50-4506-412d-a9ad-173d52e3d831 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:22.255815 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1bb8fb50-4506-412d-a9ad-173d52e3d831 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:22.266081 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1bb8fb50-4506-412d-a9ad-173d52e3d831 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:22.490953 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5caa628b-3759-4cfc-80e9-20a140fa030f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:22.500447 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-1bb8fb50-4506-412d-a9ad-173d52e3d831 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:22.501191 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5caa628b-3759-4cfc-80e9-20a140fa030f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:22.502961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5caa628b-3759-4cfc-80e9-20a140fa030f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:22.504393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5caa628b-3759-4cfc-80e9-20a140fa030f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1741 microversion: 2.20 time: 0.312651 Oct 14 13:05:22.505792 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 333/662] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:22 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1741 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:22.511206 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ffc2decd-4c0c-477c-9326-9a131ccafe5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:22.512047 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-ffc2decd-4c0c-477c-9326-9a131ccafe5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:22.518319 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-1bb8fb50-4506-412d-a9ad-173d52e3d831 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1575 microversion: 2.1 time: 0.279735 Oct 14 13:05:22.522676 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 330/663] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:22 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1575 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:05:22.525175 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ffc2decd-4c0c-477c-9326-9a131ccafe5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:22.527748 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ffc2decd-4c0c-477c-9326-9a131ccafe5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:22.528394 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ffc2decd-4c0c-477c-9326-9a131ccafe5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:22.530150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ffc2decd-4c0c-477c-9326-9a131ccafe5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:22.531027 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ffc2decd-4c0c-477c-9326-9a131ccafe5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:22.531560 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ffc2decd-4c0c-477c-9326-9a131ccafe5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:22.548767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-ffc2decd-4c0c-477c-9326-9a131ccafe5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] HTTP exception thrown: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ffc2decd-4c0c-477c-9326-9a131ccafe5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Request method failure captured: Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 HTTP/1.1 Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV1HBUZaj6qRN2kRRFOvEY7z6dWuDYr5fFNGR_t53BP1T_JHiNympyoIAtUV5VZh-RC7R8oc7LI2vtkXV6O-toJaLdv6AjTEMVya3A2r_PlPazlMIKGkh3ds1IdnF3btBZfykjpjCwVi87WsZEZUblAgouGF1iuBmm5iCnqMk6hEeGs Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 9247e549c63f4a42be20f5a7aeda0594 Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:05:22.550844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:05:22.552261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9247e549c63f4a42be20f5a7aeda0594", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:05:22.552261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:05:22.552261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 9247e549c63f4a42be20f5a7aeda0594 Oct 14 13:05:22.552261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:05:22.552261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-AttachVolumeTestJSON-974348523-project Oct 14 13:05:22.552261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:05:22.552261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:05:22.552261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 9394667740f44bcab24ee484b195fe96 Oct 14 13:05:22.552261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-AttachVolumeTestJSON-974348523-project Oct 14 13:05:22.552261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:05:22.552261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. Oct 14 13:05:22.552261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '6ad4b0b2-2eb5-4754-89fc-8fab97ffd780'} Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:05:22.553019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. Oct 14 13:05:22.554414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:22.556821 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ffc2decd-4c0c-477c-9326-9a131ccafe5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Returning 404 to user: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:05:22.557131 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ffc2decd-4c0c-477c-9326-9a131ccafe5d tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 404 len: 111 microversion: 2.1 time: 0.050100 Oct 14 13:05:22.557969 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 334/664] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:22 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:05:22.566763 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c0eafa96-6271-47b4-b05e-8755c80b4f0e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '.version_select at 0x7fbb81a16b80>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:22.603015 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c0eafa96-6271-47b4-b05e-8755c80b4f0e tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1001251075" status: 202 len: 0 microversion: 2.1 time: 0.040060 Oct 14 13:05:22.605821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 331/665] 10.222.0.47 () {58 vars in 1221 bytes} [Fri Oct 14 13:05:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1001251075 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 13:05:23.531917 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5b6dd2ae-e3ae-4b27-8711-c89a483a31c7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:23.533363 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5b6dd2ae-e3ae-4b27-8711-c89a483a31c7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:23.544289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-41b30237-9b5d-45de-b988-55838872052d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:23.544896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-41b30237-9b5d-45de-b988-55838872052d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:23.554789 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-41b30237-9b5d-45de-b988-55838872052d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:23.555213 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b6dd2ae-e3ae-4b27-8711-c89a483a31c7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:23.555956 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b6dd2ae-e3ae-4b27-8711-c89a483a31c7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:23.556607 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-41b30237-9b5d-45de-b988-55838872052d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:23.557249 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b6dd2ae-e3ae-4b27-8711-c89a483a31c7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:23.558006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b6dd2ae-e3ae-4b27-8711-c89a483a31c7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:23.558594 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-41b30237-9b5d-45de-b988-55838872052d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:23.559459 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-41b30237-9b5d-45de-b988-55838872052d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:23.560079 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b6dd2ae-e3ae-4b27-8711-c89a483a31c7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:23.560703 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-41b30237-9b5d-45de-b988-55838872052d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:23.561352 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b6dd2ae-e3ae-4b27-8711-c89a483a31c7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:23.566114 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-41b30237-9b5d-45de-b988-55838872052d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:23.765837 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-41b30237-9b5d-45de-b988-55838872052d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:23.773058 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5b6dd2ae-e3ae-4b27-8711-c89a483a31c7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:23.779412 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-41b30237-9b5d-45de-b988-55838872052d tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1562 microversion: 2.1 time: 0.239833 Oct 14 13:05:23.780503 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 332/666] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:23 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1562 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:05:23.792075 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5b6dd2ae-e3ae-4b27-8711-c89a483a31c7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:23.794455 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5b6dd2ae-e3ae-4b27-8711-c89a483a31c7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:23.796474 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5b6dd2ae-e3ae-4b27-8711-c89a483a31c7 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1741 microversion: 2.20 time: 0.269342 Oct 14 13:05:23.797799 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 335/667] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:23 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1741 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:24.835561 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c9c0b096-67bb-40e7-b4ee-95509e2505f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:24.837590 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c9c0b096-67bb-40e7-b4ee-95509e2505f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:24.847291 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c9c0b096-67bb-40e7-b4ee-95509e2505f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:24.848180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c9c0b096-67bb-40e7-b4ee-95509e2505f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:24.848836 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c9c0b096-67bb-40e7-b4ee-95509e2505f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:24.849644 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c9c0b096-67bb-40e7-b4ee-95509e2505f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:24.850299 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c9c0b096-67bb-40e7-b4ee-95509e2505f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:24.850941 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c9c0b096-67bb-40e7-b4ee-95509e2505f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:25.005780 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c9c0b096-67bb-40e7-b4ee-95509e2505f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:25.016435 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c9c0b096-67bb-40e7-b4ee-95509e2505f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:25.017898 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c9c0b096-67bb-40e7-b4ee-95509e2505f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:25.019231 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c9c0b096-67bb-40e7-b4ee-95509e2505f2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1741 microversion: 2.20 time: 0.188675 Oct 14 13:05:25.020236 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 333/668] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:24 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:25.683229 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-49cc0373-80b6-4ec3-bc64-ac08ab2959f7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:25.683875 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-49cc0373-80b6-4ec3-bc64-ac08ab2959f7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:25.693255 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-49cc0373-80b6-4ec3-bc64-ac08ab2959f7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:25.694289 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-49cc0373-80b6-4ec3-bc64-ac08ab2959f7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:25.695230 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-49cc0373-80b6-4ec3-bc64-ac08ab2959f7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:25.697856 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-49cc0373-80b6-4ec3-bc64-ac08ab2959f7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:25.698537 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-49cc0373-80b6-4ec3-bc64-ac08ab2959f7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:25.699569 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-49cc0373-80b6-4ec3-bc64-ac08ab2959f7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:25.715908 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-49cc0373-80b6-4ec3-bc64-ac08ab2959f7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] HTTP exception thrown: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-49cc0373-80b6-4ec3-bc64-ac08ab2959f7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Request method failure captured: Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: DELETE /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 HTTP/1.1 Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV1HBUZaj6qRN2kRRFOvEY7z6dWuDYr5fFNGR_t53BP1T_JHiNympyoIAtUV5VZh-RC7R8oc7LI2vtkXV6O-toJaLdv6AjTEMVya3A2r_PlPazlMIKGkh3ds1IdnF3btBZfykjpjCwVi87WsZEZUblAgouGF1iuBmm5iCnqMk6hEeGs Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 9247e549c63f4a42be20f5a7aeda0594 Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:05:25.717797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:05:25.719144 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9247e549c63f4a42be20f5a7aeda0594", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:05:25.719144 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:05:25.719144 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 9247e549c63f4a42be20f5a7aeda0594 Oct 14 13:05:25.719144 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:05:25.719144 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-AttachVolumeTestJSON-974348523-project Oct 14 13:05:25.719144 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:05:25.719144 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:05:25.719144 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 9394667740f44bcab24ee484b195fe96 Oct 14 13:05:25.719144 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-AttachVolumeTestJSON-974348523-project Oct 14 13:05:25.719144 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:05:25.719144 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. Oct 14 13:05:25.719144 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '6ad4b0b2-2eb5-4754-89fc-8fab97ffd780'} Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:05:25.719879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. Oct 14 13:05:25.721041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:25.723184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-49cc0373-80b6-4ec3-bc64-ac08ab2959f7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Returning 404 to user: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:05:25.723184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-49cc0373-80b6-4ec3-bc64-ac08ab2959f7 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 404 len: 111 microversion: 2.1 time: 0.041320 Oct 14 13:05:25.723184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 336/669] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:05:25 2022] DELETE /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:05:25.734609 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a46fa5c7-28bc-418e-bff8-7d581f4ba22b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:25.735596 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-a46fa5c7-28bc-418e-bff8-7d581f4ba22b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:25.741953 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a46fa5c7-28bc-418e-bff8-7d581f4ba22b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:25.742975 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a46fa5c7-28bc-418e-bff8-7d581f4ba22b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:25.743420 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a46fa5c7-28bc-418e-bff8-7d581f4ba22b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:25.744153 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a46fa5c7-28bc-418e-bff8-7d581f4ba22b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:25.744735 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a46fa5c7-28bc-418e-bff8-7d581f4ba22b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:25.745171 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a46fa5c7-28bc-418e-bff8-7d581f4ba22b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:25.765879 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-a46fa5c7-28bc-418e-bff8-7d581f4ba22b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] HTTP exception thrown: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a46fa5c7-28bc-418e-bff8-7d581f4ba22b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Request method failure captured: Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 HTTP/1.1 Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1HBUZaj6qRN2kRRFOvEY7z6dWuDYr5fFNGR_t53BP1T_JHiNympyoIAtUV5VZh-RC7R8oc7LI2vtkXV6O-toJaLdv6AjTEMVya3A2r_PlPazlMIKGkh3ds1IdnF3btBZfykjpjCwVi87WsZEZUblAgouGF1iuBmm5iCnqMk6hEeGs Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 9247e549c63f4a42be20f5a7aeda0594 Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:05:25.767547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:05:25.769078 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9247e549c63f4a42be20f5a7aeda0594", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:05:25.769078 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:05:25.769078 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 9247e549c63f4a42be20f5a7aeda0594 Oct 14 13:05:25.769078 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:05:25.769078 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-AttachVolumeTestJSON-974348523-project Oct 14 13:05:25.769078 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:05:25.769078 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:05:25.769078 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 9394667740f44bcab24ee484b195fe96 Oct 14 13:05:25.769078 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-AttachVolumeTestJSON-974348523-project Oct 14 13:05:25.769078 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:05:25.769078 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. Oct 14 13:05:25.769078 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '6ad4b0b2-2eb5-4754-89fc-8fab97ffd780'} Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:05:25.769846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. Oct 14 13:05:25.771042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:25.772223 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a46fa5c7-28bc-418e-bff8-7d581f4ba22b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Returning 404 to user: Instance 6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:05:25.772223 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-a46fa5c7-28bc-418e-bff8-7d581f4ba22b tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780" status: 404 len: 111 microversion: 2.1 time: 0.042204 Oct 14 13:05:25.772223 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 334/670] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:25 2022] GET /compute/v2.1/servers/6ad4b0b2-2eb5-4754-89fc-8fab97ffd780 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:05:26.053843 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2153fa1f-0207-4156-92d7-43e4299d0f91 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:26.054751 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2153fa1f-0207-4156-92d7-43e4299d0f91 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:26.063187 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2153fa1f-0207-4156-92d7-43e4299d0f91 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:26.066062 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2153fa1f-0207-4156-92d7-43e4299d0f91 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:26.066975 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2153fa1f-0207-4156-92d7-43e4299d0f91 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:26.068641 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2153fa1f-0207-4156-92d7-43e4299d0f91 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:26.069359 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2153fa1f-0207-4156-92d7-43e4299d0f91 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:26.070049 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2153fa1f-0207-4156-92d7-43e4299d0f91 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:26.307803 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2153fa1f-0207-4156-92d7-43e4299d0f91 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:26.317731 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2153fa1f-0207-4156-92d7-43e4299d0f91 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:26.319647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2153fa1f-0207-4156-92d7-43e4299d0f91 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:26.321226 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2153fa1f-0207-4156-92d7-43e4299d0f91 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1741 microversion: 2.20 time: 0.273533 Oct 14 13:05:26.345986 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 337/671] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:26 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1741 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:26.958616 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8d02d3e6-530d-4f41-81d7-1f56420bab5a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:26.959232 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8d02d3e6-530d-4f41-81d7-1f56420bab5a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:26.966774 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d02d3e6-530d-4f41-81d7-1f56420bab5a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:26.967272 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d02d3e6-530d-4f41-81d7-1f56420bab5a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:26.967705 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d02d3e6-530d-4f41-81d7-1f56420bab5a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:26.968412 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d02d3e6-530d-4f41-81d7-1f56420bab5a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:26.968867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d02d3e6-530d-4f41-81d7-1f56420bab5a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:26.969292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d02d3e6-530d-4f41-81d7-1f56420bab5a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:26.997743 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-8d02d3e6-530d-4f41-81d7-1f56420bab5a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] HTTP exception thrown: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8d02d3e6-530d-4f41-81d7-1f56420bab5a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Request method failure captured: Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: DELETE /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 HTTP/1.1 Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1HBUZaj6qRN2kRRFOvEY7z6dWuDYr5fFNGR_t53BP1T_JHiNympyoIAtUV5VZh-RC7R8oc7LI2vtkXV6O-toJaLdv6AjTEMVya3A2r_PlPazlMIKGkh3ds1IdnF3btBZfykjpjCwVi87WsZEZUblAgouGF1iuBmm5iCnqMk6hEeGs Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 9247e549c63f4a42be20f5a7aeda0594 Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:05:26.999613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:05:27.000979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9247e549c63f4a42be20f5a7aeda0594", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:05:27.000979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:05:27.000979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 9247e549c63f4a42be20f5a7aeda0594 Oct 14 13:05:27.000979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:05:27.000979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-AttachVolumeTestJSON-974348523-project Oct 14 13:05:27.000979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:05:27.000979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:05:27.000979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 9394667740f44bcab24ee484b195fe96 Oct 14 13:05:27.000979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-AttachVolumeTestJSON-974348523-project Oct 14 13:05:27.000979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:05:27.000979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. Oct 14 13:05:27.000979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '24c6dfd1-715d-4239-a767-32f2e2dcf892'} Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:05:27.001779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. Oct 14 13:05:27.002988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:27.005923 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8d02d3e6-530d-4f41-81d7-1f56420bab5a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Returning 404 to user: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:05:27.006800 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8d02d3e6-530d-4f41-81d7-1f56420bab5a tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "DELETE /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 404 len: 111 microversion: 2.1 time: 0.052426 Oct 14 13:05:27.007379 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 335/672] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:05:26 2022] DELETE /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:05:27.015824 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9f75f506-0f27-49a0-afa8-ff8ddf672719 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:27.016609 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-9f75f506-0f27-49a0-afa8-ff8ddf672719 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] [instance: 24c6dfd1-715d-4239-a767-32f2e2dcf892] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:27.025251 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9f75f506-0f27-49a0-afa8-ff8ddf672719 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:27.025898 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9f75f506-0f27-49a0-afa8-ff8ddf672719 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:27.026410 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9f75f506-0f27-49a0-afa8-ff8ddf672719 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:27.027537 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9f75f506-0f27-49a0-afa8-ff8ddf672719 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:27.027999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9f75f506-0f27-49a0-afa8-ff8ddf672719 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:27.028434 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9f75f506-0f27-49a0-afa8-ff8ddf672719 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:27.044571 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-9f75f506-0f27-49a0-afa8-ff8ddf672719 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] HTTP exception thrown: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9f75f506-0f27-49a0-afa8-ff8ddf672719 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Request method failure captured: Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 HTTP/1.1 Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV1HBUZaj6qRN2kRRFOvEY7z6dWuDYr5fFNGR_t53BP1T_JHiNympyoIAtUV5VZh-RC7R8oc7LI2vtkXV6O-toJaLdv6AjTEMVya3A2r_PlPazlMIKGkh3ds1IdnF3btBZfykjpjCwVi87WsZEZUblAgouGF1iuBmm5iCnqMk6hEeGs Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 9247e549c63f4a42be20f5a7aeda0594 Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:05:27.046227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:05:27.047575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9247e549c63f4a42be20f5a7aeda0594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9247e549c63f4a42be20f5a7aeda0594", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:05:27.047575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:05:27.047575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 9247e549c63f4a42be20f5a7aeda0594 Oct 14 13:05:27.047575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-AttachVolumeTestJSON-974348523 Oct 14 13:05:27.047575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-AttachVolumeTestJSON-974348523-project Oct 14 13:05:27.047575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:05:27.047575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:05:27.047575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 9394667740f44bcab24ee484b195fe96 Oct 14 13:05:27.047575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-AttachVolumeTestJSON-974348523-project Oct 14 13:05:27.047575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:05:27.047575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. Oct 14 13:05:27.047575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '24c6dfd1-715d-4239-a767-32f2e2dcf892'} Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:05:27.048385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. Oct 14 13:05:27.049746 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:27.050863 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9f75f506-0f27-49a0-afa8-ff8ddf672719 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] Returning 404 to user: Instance 24c6dfd1-715d-4239-a767-32f2e2dcf892 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:05:27.050863 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-9f75f506-0f27-49a0-afa8-ff8ddf672719 tempest-AttachVolumeTestJSON-974348523 tempest-AttachVolumeTestJSON-974348523-project] 10.222.0.47 "GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892" status: 404 len: 111 microversion: 2.1 time: 0.035890 Oct 14 13:05:27.050863 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 338/673] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:27 2022] GET /compute/v2.1/servers/24c6dfd1-715d-4239-a767-32f2e2dcf892 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 13:05:27.350236 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0137ade2-85bf-470e-b168-e74acf33dac4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:27.351115 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-0137ade2-85bf-470e-b168-e74acf33dac4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:27.359572 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0137ade2-85bf-470e-b168-e74acf33dac4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:27.360429 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0137ade2-85bf-470e-b168-e74acf33dac4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:27.361052 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0137ade2-85bf-470e-b168-e74acf33dac4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:27.361877 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0137ade2-85bf-470e-b168-e74acf33dac4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:27.362409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0137ade2-85bf-470e-b168-e74acf33dac4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:27.363098 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0137ade2-85bf-470e-b168-e74acf33dac4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:27.557100 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-0137ade2-85bf-470e-b168-e74acf33dac4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:27.565775 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-0137ade2-85bf-470e-b168-e74acf33dac4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:27.567222 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-0137ade2-85bf-470e-b168-e74acf33dac4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:27.568389 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-0137ade2-85bf-470e-b168-e74acf33dac4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1741 microversion: 2.20 time: 0.222813 Oct 14 13:05:27.568936 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 336/674] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:27 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1741 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:28.594066 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c9eacc2c-bb8f-4ea4-bd06-2625e160b37f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:28.595358 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c9eacc2c-bb8f-4ea4-bd06-2625e160b37f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:28.602215 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c9eacc2c-bb8f-4ea4-bd06-2625e160b37f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:28.602948 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c9eacc2c-bb8f-4ea4-bd06-2625e160b37f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:28.603542 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c9eacc2c-bb8f-4ea4-bd06-2625e160b37f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:28.604409 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c9eacc2c-bb8f-4ea4-bd06-2625e160b37f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:28.605020 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c9eacc2c-bb8f-4ea4-bd06-2625e160b37f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:28.605643 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c9eacc2c-bb8f-4ea4-bd06-2625e160b37f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:29.161797 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c9eacc2c-bb8f-4ea4-bd06-2625e160b37f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:29.171073 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c9eacc2c-bb8f-4ea4-bd06-2625e160b37f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:29.172950 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c9eacc2c-bb8f-4ea4-bd06-2625e160b37f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:29.174911 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c9eacc2c-bb8f-4ea4-bd06-2625e160b37f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1741 microversion: 2.20 time: 0.584651 Oct 14 13:05:29.193871 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 339/675] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:28 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1741 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:30.208206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-3d563588-2bb6-4e8a-b701-b26ae0b3158b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:30.209156 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-3d563588-2bb6-4e8a-b701-b26ae0b3158b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:30.216865 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3d563588-2bb6-4e8a-b701-b26ae0b3158b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:30.217462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3d563588-2bb6-4e8a-b701-b26ae0b3158b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:30.218044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3d563588-2bb6-4e8a-b701-b26ae0b3158b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:30.219355 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3d563588-2bb6-4e8a-b701-b26ae0b3158b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:30.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3d563588-2bb6-4e8a-b701-b26ae0b3158b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:30.220584 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3d563588-2bb6-4e8a-b701-b26ae0b3158b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:30.468106 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-3d563588-2bb6-4e8a-b701-b26ae0b3158b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:30.478524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-3d563588-2bb6-4e8a-b701-b26ae0b3158b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:30.480955 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-3d563588-2bb6-4e8a-b701-b26ae0b3158b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:30.482430 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-3d563588-2bb6-4e8a-b701-b26ae0b3158b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1723 microversion: 2.20 time: 0.278672 Oct 14 13:05:30.495403 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 337/676] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:30 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:31.510555 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b113adb5-7ee2-4a7d-8d48-2d79e279f544 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:31.510555 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b113adb5-7ee2-4a7d-8d48-2d79e279f544 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:31.518320 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b113adb5-7ee2-4a7d-8d48-2d79e279f544 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:31.518946 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b113adb5-7ee2-4a7d-8d48-2d79e279f544 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:31.519159 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b113adb5-7ee2-4a7d-8d48-2d79e279f544 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:31.519861 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b113adb5-7ee2-4a7d-8d48-2d79e279f544 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:31.529134 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b113adb5-7ee2-4a7d-8d48-2d79e279f544 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:31.529730 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b113adb5-7ee2-4a7d-8d48-2d79e279f544 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:31.698748 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b113adb5-7ee2-4a7d-8d48-2d79e279f544 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:31.707158 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b113adb5-7ee2-4a7d-8d48-2d79e279f544 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:31.708629 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b113adb5-7ee2-4a7d-8d48-2d79e279f544 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:31.710027 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b113adb5-7ee2-4a7d-8d48-2d79e279f544 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1726 microversion: 2.20 time: 0.206058 Oct 14 13:05:31.710761 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 340/677] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:31 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1726 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:31.739249 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2c294236-037c-4185-a571-b16dc20fd86b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92b9f8e6-cab1-4bd8-a08f-a531ba5e049c"}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:05:31.742087 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-2c294236-037c-4185-a571-b16dc20fd86b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:31.749077 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2c294236-037c-4185-a571-b16dc20fd86b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:31.749820 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2c294236-037c-4185-a571-b16dc20fd86b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:31.750750 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2c294236-037c-4185-a571-b16dc20fd86b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:31.752096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2c294236-037c-4185-a571-b16dc20fd86b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:31.752645 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2c294236-037c-4185-a571-b16dc20fd86b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:31.753108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2c294236-037c-4185-a571-b16dc20fd86b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:32.124779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-2c294236-037c-4185-a571-b16dc20fd86b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "POST /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.389734 Oct 14 13:05:32.126178 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 338/678] 10.222.0.47 () {62 vars in 1364 bytes} [Fri Oct 14 13:05:31 2022] POST /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87/os-volume_attachments => generated 188 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 14 13:05:32.266626 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1d049821-e6fb-4817-ad4f-c4cd8b626e59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:32.272927 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1d049821-e6fb-4817-ad4f-c4cd8b626e59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:32.278950 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d049821-e6fb-4817-ad4f-c4cd8b626e59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:32.279444 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d049821-e6fb-4817-ad4f-c4cd8b626e59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:32.279883 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d049821-e6fb-4817-ad4f-c4cd8b626e59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:32.280747 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d049821-e6fb-4817-ad4f-c4cd8b626e59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:32.281022 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d049821-e6fb-4817-ad4f-c4cd8b626e59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:32.281440 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d049821-e6fb-4817-ad4f-c4cd8b626e59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:32.304278 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=100 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:32.543939 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-fb44c6bb-d2d6-4127-ad94-cfe1eaf93fe0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:32.544429 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-fb44c6bb-d2d6-4127-ad94-cfe1eaf93fe0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:32.551511 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fb44c6bb-d2d6-4127-ad94-cfe1eaf93fe0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:32.552200 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fb44c6bb-d2d6-4127-ad94-cfe1eaf93fe0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:32.552633 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fb44c6bb-d2d6-4127-ad94-cfe1eaf93fe0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:32.553840 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fb44c6bb-d2d6-4127-ad94-cfe1eaf93fe0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:32.554454 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fb44c6bb-d2d6-4127-ad94-cfe1eaf93fe0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:32.555561 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fb44c6bb-d2d6-4127-ad94-cfe1eaf93fe0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:32.583166 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1d049821-e6fb-4817-ad4f-c4cd8b626e59 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87/os-volume_attachments/92b9f8e6-cab1-4bd8-a08f-a531ba5e049c" status: 202 len: 0 microversion: 2.20 time: 0.320278 Oct 14 13:05:32.584851 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 341/679] 10.222.0.47 () {60 vars in 1457 bytes} [Fri Oct 14 13:05:32 2022] DELETE /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87/os-volume_attachments/92b9f8e6-cab1-4bd8-a08f-a531ba5e049c => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:05:32.586966 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-fb44c6bb-d2d6-4127-ad94-cfe1eaf93fe0 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/ips" status: 200 len: 149 microversion: 2.1 time: 0.318907 Oct 14 13:05:32.587514 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 339/680] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Oct 14 13:05:32 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/ips => generated 149 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:32.665134 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c0177da1-53fb-4dd7-9f81-15dc4807f566 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:05:32.665764 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c0177da1-53fb-4dd7-9f81-15dc4807f566 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:32.672319 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c0177da1-53fb-4dd7-9f81-15dc4807f566 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:32.672813 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c0177da1-53fb-4dd7-9f81-15dc4807f566 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:32.673249 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c0177da1-53fb-4dd7-9f81-15dc4807f566 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:32.673988 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c0177da1-53fb-4dd7-9f81-15dc4807f566 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:32.674440 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c0177da1-53fb-4dd7-9f81-15dc4807f566 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:32.675170 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c0177da1-53fb-4dd7-9f81-15dc4807f566 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:32.710817 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c0177da1-53fb-4dd7-9f81-15dc4807f566 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118868) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 14 13:05:32.812555 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c0177da1-53fb-4dd7-9f81-15dc4807f566 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "POST /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87/action" status: 202 len: 0 microversion: 2.20 time: 0.150719 Oct 14 13:05:32.818409 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 342/681] 10.222.0.47 () {62 vars in 1319 bytes} [Fri Oct 14 13:05:32 2022] POST /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:05:32.824655 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a523e5f6-233d-4360-a3c8-fc8c00afba82 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:32.825281 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-a523e5f6-233d-4360-a3c8-fc8c00afba82 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:32.833531 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a523e5f6-233d-4360-a3c8-fc8c00afba82 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:32.834031 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a523e5f6-233d-4360-a3c8-fc8c00afba82 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:32.834470 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a523e5f6-233d-4360-a3c8-fc8c00afba82 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:32.835684 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a523e5f6-233d-4360-a3c8-fc8c00afba82 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:32.836176 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a523e5f6-233d-4360-a3c8-fc8c00afba82 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:32.836604 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a523e5f6-233d-4360-a3c8-fc8c00afba82 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:33.071037 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a523e5f6-233d-4360-a3c8-fc8c00afba82 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:33.079741 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a523e5f6-233d-4360-a3c8-fc8c00afba82 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:33.082483 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a523e5f6-233d-4360-a3c8-fc8c00afba82 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:33.083919 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-a523e5f6-233d-4360-a3c8-fc8c00afba82 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1674 microversion: 2.20 time: 0.263803 Oct 14 13:05:33.085005 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 340/682] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:32 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1674 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:33.592651 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1aea0590-856c-4999-a5ba-49acd2795dc7 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Action: 'create', calling method: .version_select at 0x7fbb81a37430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-841486672"}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:05:33.930507 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-d83f83e7-0741-4849-bb6a-811c1ddf2ea8 req-907be69b-8995-4fbd-af05-f46d569e0c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bff20a0-76b8-44e6-9f5c-87a9fce18f87", "name": "network-vif-unplugged", "status": "completed", "tag": "096cc001-9ca8-472a-8f3d-2a345a805218"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:05:33.950546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-d83f83e7-0741-4849-bb6a-811c1ddf2ea8 req-907be69b-8995-4fbd-af05-f46d569e0c9c service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:33.951463 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-d83f83e7-0741-4849-bb6a-811c1ddf2ea8 req-907be69b-8995-4fbd-af05-f46d569e0c9c service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:33.953348 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-d83f83e7-0741-4849-bb6a-811c1ddf2ea8 req-907be69b-8995-4fbd-af05-f46d569e0c9c service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:33.984085 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1aea0590-856c-4999-a5ba-49acd2795dc7 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.677923 Oct 14 13:05:33.985044 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 343/683] 10.222.0.47 () {60 vars in 1155 bytes} [Fri Oct 14 13:05:33 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 680 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 14 13:05:33.990813 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-d83f83e7-0741-4849-bb6a-811c1ddf2ea8 req-907be69b-8995-4fbd-af05-f46d569e0c9c service nova] Creating event network-vif-unplugged:096cc001-9ca8-472a-8f3d-2a345a805218 for instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 on hv-cinder-82099 Oct 14 13:05:34.000988 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-292ccf69-5a6e-43dd-a793-fdf36cead33d tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb819f7430>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:34.014649 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-d83f83e7-0741-4849-bb6a-811c1ddf2ea8 req-907be69b-8995-4fbd-af05-f46d569e0c9c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088749 Oct 14 13:05:34.015396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 341/684] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:05:34.075808 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-292ccf69-5a6e-43dd-a793-fdf36cead33d tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94" status: 200 len: 344 microversion: 2.1 time: 0.079603 Oct 14 13:05:34.076745 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 344/685] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Oct 14 13:05:33 2022] GET /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:34.090163 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-76876611-318f-490d-b3ed-f58fec9be8b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5aa7edc7-ebc7-488c-8f75-ad4987f646ee"}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:05:34.092822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-76876611-318f-490d-b3ed-f58fec9be8b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:34.099422 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-76876611-318f-490d-b3ed-f58fec9be8b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:34.099915 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-76876611-318f-490d-b3ed-f58fec9be8b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:34.100346 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-76876611-318f-490d-b3ed-f58fec9be8b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:34.101091 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-76876611-318f-490d-b3ed-f58fec9be8b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:34.102259 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-76876611-318f-490d-b3ed-f58fec9be8b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:34.102871 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-76876611-318f-490d-b3ed-f58fec9be8b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:34.107012 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:34.111199 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0d6c0221-6d9c-41dd-a735-713b56ac974f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:34.111945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0d6c0221-6d9c-41dd-a735-713b56ac974f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:34.120454 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d6c0221-6d9c-41dd-a735-713b56ac974f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:34.127972 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d6c0221-6d9c-41dd-a735-713b56ac974f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:34.128758 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d6c0221-6d9c-41dd-a735-713b56ac974f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:34.129758 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d6c0221-6d9c-41dd-a735-713b56ac974f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:34.130435 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d6c0221-6d9c-41dd-a735-713b56ac974f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:34.131078 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d6c0221-6d9c-41dd-a735-713b56ac974f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:34.371311 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0d6c0221-6d9c-41dd-a735-713b56ac974f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:34.380827 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0d6c0221-6d9c-41dd-a735-713b56ac974f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:34.383451 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0d6c0221-6d9c-41dd-a735-713b56ac974f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:34.384830 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0d6c0221-6d9c-41dd-a735-713b56ac974f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.277763 Oct 14 13:05:34.386041 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 345/686] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:34 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:34.415217 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-76876611-318f-490d-b3ed-f58fec9be8b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "POST /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329662 Oct 14 13:05:34.416106 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 342/687] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Oct 14 13:05:34 2022] POST /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:35.090003 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4bf1c1a2-6690-4b44-81a4-3c7b2d8bf3ac tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb81a37f70>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:35.151642 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4bf1c1a2-6690-4b44-81a4-3c7b2d8bf3ac tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94" status: 200 len: 345 microversion: 2.1 time: 0.065696 Oct 14 13:05:35.152244 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 346/688] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Oct 14 13:05:35 2022] GET /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:35.167368 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-aeffa1f0-61d1-420b-9dac-ffaaed5ab86e tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Action: 'create', calling method: .version_select at 0x7fbb827e91f0>, body: {"snapshot": {"volume_id": "3a3cd6d0-399f-4c29-82b0-ed9fb9872d94", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1765845963"}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:05:35.398574 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-aeffa1f0-61d1-420b-9dac-ffaaed5ab86e tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.235937 Oct 14 13:05:35.414566 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 343/689] 10.222.0.47 () {60 vars in 1162 bytes} [Fri Oct 14 13:05:35 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:35.423040 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c3df4f31-f7d0-4c15-a2da-b69fbfa9f04f tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb819f74c0>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:35.434503 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8bde4ab2-fe3f-4168-b76f-d70dce21a0c9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:35.438908 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8bde4ab2-fe3f-4168-b76f-d70dce21a0c9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:35.499332 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8bde4ab2-fe3f-4168-b76f-d70dce21a0c9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:35.500360 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8bde4ab2-fe3f-4168-b76f-d70dce21a0c9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:35.504315 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8bde4ab2-fe3f-4168-b76f-d70dce21a0c9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:35.510204 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8bde4ab2-fe3f-4168-b76f-d70dce21a0c9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:35.511103 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8bde4ab2-fe3f-4168-b76f-d70dce21a0c9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:35.514732 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8bde4ab2-fe3f-4168-b76f-d70dce21a0c9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:35.540597 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c3df4f31-f7d0-4c15-a2da-b69fbfa9f04f tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6" status: 200 len: 287 microversion: 2.1 time: 0.130853 Oct 14 13:05:35.548177 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 347/690] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Oct 14 13:05:35 2022] GET /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6 => generated 287 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:35.555520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-293ac41e-d9c2-4bf2-9caf-f26ac3422480 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb819f7ca0>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:35.631085 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-293ac41e-d9c2-4bf2-9caf-f26ac3422480 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.081091 Oct 14 13:05:35.633318 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 348/691] 10.222.0.47 () {58 vars in 1140 bytes} [Fri Oct 14 13:05:35 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:35.645812 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-647733c1-90ea-499c-a43d-add9f082b63d tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb819f7af0>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:35.720362 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-647733c1-90ea-499c-a43d-add9f082b63d tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6" status: 200 len: 287 microversion: 2.1 time: 0.078658 Oct 14 13:05:35.721205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 349/692] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Oct 14 13:05:35 2022] GET /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:35.810213 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8bde4ab2-fe3f-4168-b76f-d70dce21a0c9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:35.820591 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8bde4ab2-fe3f-4168-b76f-d70dce21a0c9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:35.822436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8bde4ab2-fe3f-4168-b76f-d70dce21a0c9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:35.823890 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8bde4ab2-fe3f-4168-b76f-d70dce21a0c9 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.407909 Oct 14 13:05:35.824679 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 344/693] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:35 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:36.735713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-cbc2e0c8-0234-4c84-aed8-3e972618e2b2 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb81a37310>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:36.776357 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-cbc2e0c8-0234-4c84-aed8-3e972618e2b2 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6" status: 200 len: 287 microversion: 2.1 time: 0.045123 Oct 14 13:05:36.776994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 350/694] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Oct 14 13:05:36 2022] GET /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:36.849623 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-fdf022b8-8c08-46c7-9cb4-692f4b74ca0d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:36.851505 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-fdf022b8-8c08-46c7-9cb4-692f4b74ca0d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:36.858683 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdf022b8-8c08-46c7-9cb4-692f4b74ca0d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:36.859171 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdf022b8-8c08-46c7-9cb4-692f4b74ca0d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:36.859605 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdf022b8-8c08-46c7-9cb4-692f4b74ca0d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:36.860614 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdf022b8-8c08-46c7-9cb4-692f4b74ca0d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:36.861237 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdf022b8-8c08-46c7-9cb4-692f4b74ca0d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:36.861718 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdf022b8-8c08-46c7-9cb4-692f4b74ca0d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:37.032839 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-fdf022b8-8c08-46c7-9cb4-692f4b74ca0d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:37.041868 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-fdf022b8-8c08-46c7-9cb4-692f4b74ca0d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:37.043586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-fdf022b8-8c08-46c7-9cb4-692f4b74ca0d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:37.044846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-fdf022b8-8c08-46c7-9cb4-692f4b74ca0d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.199204 Oct 14 13:05:37.045403 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 345/695] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:36 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:37.790362 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-bf029961-07a9-43ca-a01c-de55a46ffe1d tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb81985160>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:37.827902 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-bf029961-07a9-43ca-a01c-de55a46ffe1d tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6" status: 200 len: 287 microversion: 2.1 time: 0.042553 Oct 14 13:05:37.835311 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 351/696] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Oct 14 13:05:37 2022] GET /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:38.073501 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-775f9164-a30c-4b35-8f50-5dcc1b7ca0f1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:38.074380 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-775f9164-a30c-4b35-8f50-5dcc1b7ca0f1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:38.082018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-775f9164-a30c-4b35-8f50-5dcc1b7ca0f1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:38.082501 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-775f9164-a30c-4b35-8f50-5dcc1b7ca0f1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:38.083216 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-775f9164-a30c-4b35-8f50-5dcc1b7ca0f1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:38.084446 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-775f9164-a30c-4b35-8f50-5dcc1b7ca0f1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:38.085051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-775f9164-a30c-4b35-8f50-5dcc1b7ca0f1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:38.086408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-775f9164-a30c-4b35-8f50-5dcc1b7ca0f1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:38.258755 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-775f9164-a30c-4b35-8f50-5dcc1b7ca0f1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:38.267645 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-775f9164-a30c-4b35-8f50-5dcc1b7ca0f1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:38.269293 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-775f9164-a30c-4b35-8f50-5dcc1b7ca0f1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:38.270479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-775f9164-a30c-4b35-8f50-5dcc1b7ca0f1 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.203439 Oct 14 13:05:38.271026 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 346/697] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:38 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:38.843093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7d98ed66-8835-4756-bf52-72502bf0912f tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb81a37940>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:38.887956 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7d98ed66-8835-4756-bf52-72502bf0912f tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6" status: 200 len: 288 microversion: 2.1 time: 0.049191 Oct 14 13:05:38.888604 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 352/698] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Oct 14 13:05:38 2022] GET /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6 => generated 288 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:05:38.901310 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-b3344aa1-7e4c-4995-b650-49188c0a7b46 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb819fe700>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:38.990166 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-b3344aa1-7e4c-4995-b650-49188c0a7b46 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6" status: 202 len: 0 microversion: 2.1 time: 0.093028 Oct 14 13:05:38.990741 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 347/699] 10.222.0.47 () {58 vars in 1254 bytes} [Fri Oct 14 13:05:38 2022] DELETE /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:05:39.000402 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-3b23897f-eee2-4359-9990-2e55a8b0425e tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb819f70d0>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:39.040092 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-3b23897f-eee2-4359-9990-2e55a8b0425e tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6" status: 200 len: 287 microversion: 2.1 time: 0.043342 Oct 14 13:05:39.045728 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 353/700] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Oct 14 13:05:38 2022] GET /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:39.297059 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-60cd4bf4-1944-44dd-80a6-4033afe7b40d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:39.298417 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-60cd4bf4-1944-44dd-80a6-4033afe7b40d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:39.304560 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-60cd4bf4-1944-44dd-80a6-4033afe7b40d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:39.305221 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-60cd4bf4-1944-44dd-80a6-4033afe7b40d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:39.305694 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-60cd4bf4-1944-44dd-80a6-4033afe7b40d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:39.306444 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-60cd4bf4-1944-44dd-80a6-4033afe7b40d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:39.311919 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-60cd4bf4-1944-44dd-80a6-4033afe7b40d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:39.312403 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-60cd4bf4-1944-44dd-80a6-4033afe7b40d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:39.486971 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-60cd4bf4-1944-44dd-80a6-4033afe7b40d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:39.496922 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-60cd4bf4-1944-44dd-80a6-4033afe7b40d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:39.498486 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-60cd4bf4-1944-44dd-80a6-4033afe7b40d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:39.500021 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-60cd4bf4-1944-44dd-80a6-4033afe7b40d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.207464 Oct 14 13:05:39.520238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 348/701] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:39 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:40.053939 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-fa4c8dfa-33a7-4ba0-97e1-c1123194a8a1 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb819a83a0>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:40.088358 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-fa4c8dfa-33a7-4ba0-97e1-c1123194a8a1 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] HTTP exception thrown: Snapshot 42af842e-51e4-4c66-be48-a838d0b8afa6 could not be found. Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-fa4c8dfa-33a7-4ba0-97e1-c1123194a8a1 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Request method failure captured: Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6 HTTP/1.1 Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV6dTtiQO3Rai44oUEL6qkOaz8Rina_i_BA4DiHbWi5uJHARliKKCLQ9bWm5OMzqPYG0GJYmEoWk1DF3Jf3hPKA1ByDUG50Auj5SC_W6xRzygcXC_aGNVGXdi37yy5CUhlwfgqPO_h1tovFOtnXt9OzQI3DvlgfiM3DWpL1P7o-Zgjo Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 5044e322520f485d942885c4ce6554b2 Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1486020065 Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:05:40.090814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:05:40.092458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5044e322520f485d942885c4ce6554b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5044e322520f485d942885c4ce6554b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5044e322520f485d942885c4ce6554b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5044e322520f485d942885c4ce6554b2", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:05:40.092458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1486020065 Oct 14 13:05:40.092458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 5044e322520f485d942885c4ce6554b2 Oct 14 13:05:40.092458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1486020065 Oct 14 13:05:40.092458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-VolumesSnapshotsTestJSON-1486020065-project Oct 14 13:05:40.092458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:05:40.092458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:05:40.092458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 5ceb0f3e22b246d8a3f5ced16295fa80 Oct 14 13:05:40.092458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1486020065-project Oct 14 13:05:40.092458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: Oct 14 13:05:40.092458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Snapshot 42af842e-51e4-4c66-be48-a838d0b8afa6 could not be found. Oct 14 13:05:40.092458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '42af842e-51e4-4c66-be48-a838d0b8afa6'} Oct 14 13:05:40.092458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 42af842e-51e4-4c66-be48-a838d0b8afa6 could not be found. (HTTP 404) (Request-ID: req-7f06666e-b2ba-4155-850c-660dbcb8f6d9) Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:40.093712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 13:05:40.095093 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 42af842e-51e4-4c66-be48-a838d0b8afa6 could not be found. Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 14 13:05:40.096669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:05:40.098192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 42af842e-51e4-4c66-be48-a838d0b8afa6 could not be found. Oct 14 13:05:40.098192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:40.098192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:40.098192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:40.098192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:40.098192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:40.098192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:40.098192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:05:40.098192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:05:40.098192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 42af842e-51e4-4c66-be48-a838d0b8afa6 could not be found. Oct 14 13:05:40.098192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:40.098192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-fa4c8dfa-33a7-4ba0-97e1-c1123194a8a1 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Returning 404 to user: Snapshot 42af842e-51e4-4c66-be48-a838d0b8afa6 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:05:40.098192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-fa4c8dfa-33a7-4ba0-97e1-c1123194a8a1 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6" status: 404 len: 111 microversion: 2.1 time: 0.043762 Oct 14 13:05:40.099160 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 354/702] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Oct 14 13:05:40 2022] GET /compute/v2.1/os-snapshots/42af842e-51e4-4c66-be48-a838d0b8afa6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:05:40.103520 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-56bc61df-898e-497a-8211-0c9a0eae498e tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb81a30040>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:40.179931 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-56bc61df-898e-497a-8211-0c9a0eae498e tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94" status: 202 len: 0 microversion: 2.1 time: 0.082556 Oct 14 13:05:40.181671 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 349/703] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Oct 14 13:05:40 2022] DELETE /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:05:40.189777 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-27090647-f61f-4840-bc56-08b063a09b15 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb81a37940>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:40.258027 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-27090647-f61f-4840-bc56-08b063a09b15 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94" status: 200 len: 344 microversion: 2.1 time: 0.071685 Oct 14 13:05:40.259129 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 355/704] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Oct 14 13:05:40 2022] GET /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:05:40.527080 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-157ab444-e53d-4843-ab82-77a6bbb8dc74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:40.527690 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-157ab444-e53d-4843-ab82-77a6bbb8dc74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:40.533918 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-157ab444-e53d-4843-ab82-77a6bbb8dc74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:40.534406 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-157ab444-e53d-4843-ab82-77a6bbb8dc74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:40.534836 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-157ab444-e53d-4843-ab82-77a6bbb8dc74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:40.535536 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-157ab444-e53d-4843-ab82-77a6bbb8dc74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:40.535986 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-157ab444-e53d-4843-ab82-77a6bbb8dc74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:40.536409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-157ab444-e53d-4843-ab82-77a6bbb8dc74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:40.682114 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-157ab444-e53d-4843-ab82-77a6bbb8dc74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:40.691263 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-157ab444-e53d-4843-ab82-77a6bbb8dc74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:40.693068 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-157ab444-e53d-4843-ab82-77a6bbb8dc74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:40.694279 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-157ab444-e53d-4843-ab82-77a6bbb8dc74 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.171921 Oct 14 13:05:40.694867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 350/705] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:40 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:41.272784 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f1281d91-0690-4872-9703-401759cc54b2 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb819a8820>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:41.302455 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-f1281d91-0690-4872-9703-401759cc54b2 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] HTTP exception thrown: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f1281d91-0690-4872-9703-401759cc54b2 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Request method failure captured: Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 HTTP/1.1 Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV6dTtiQO3Rai44oUEL6qkOaz8Rina_i_BA4DiHbWi5uJHARliKKCLQ9bWm5OMzqPYG0GJYmEoWk1DF3Jf3hPKA1ByDUG50Auj5SC_W6xRzygcXC_aGNVGXdi37yy5CUhlwfgqPO_h1tovFOtnXt9OzQI3DvlgfiM3DWpL1P7o-Zgjo Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 5044e322520f485d942885c4ce6554b2 Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1486020065 Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:05:41.304420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:05:41.306150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5044e322520f485d942885c4ce6554b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5044e322520f485d942885c4ce6554b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5044e322520f485d942885c4ce6554b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5044e322520f485d942885c4ce6554b2", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:05:41.306150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1486020065 Oct 14 13:05:41.306150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 5044e322520f485d942885c4ce6554b2 Oct 14 13:05:41.306150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1486020065 Oct 14 13:05:41.306150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-VolumesSnapshotsTestJSON-1486020065-project Oct 14 13:05:41.306150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:05:41.306150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:05:41.306150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 5ceb0f3e22b246d8a3f5ced16295fa80 Oct 14 13:05:41.306150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1486020065-project Oct 14 13:05:41.306150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: Oct 14 13:05:41.306150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. Oct 14 13:05:41.306150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '3a3cd6d0-399f-4c29-82b0-ed9fb9872d94'} Oct 14 13:05:41.306150 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. (HTTP 404) (Request-ID: req-5df1af95-6362-4c3c-b91e-64bb1c2d4b13) Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:41.307303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 13:05:41.308766 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 13:05:41.310233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:05:41.311675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. Oct 14 13:05:41.311675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.311675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:41.311675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.311675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:41.311675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:41.311675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:41.311675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:05:41.311675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:05:41.311675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. Oct 14 13:05:41.311675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.311675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f1281d91-0690-4872-9703-401759cc54b2 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Returning 404 to user: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:05:41.311675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f1281d91-0690-4872-9703-401759cc54b2 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94" status: 404 len: 109 microversion: 2.1 time: 0.037442 Oct 14 13:05:41.311675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 356/706] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Oct 14 13:05:41 2022] GET /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:05:41.319751 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-39b16527-c2cc-4341-80e3-dd11fefd77a9 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb819fe8b0>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:41.350738 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-39b16527-c2cc-4341-80e3-dd11fefd77a9 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] HTTP exception thrown: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-39b16527-c2cc-4341-80e3-dd11fefd77a9 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Request method failure captured: Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: DELETE /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 HTTP/1.1 Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV6dTtiQO3Rai44oUEL6qkOaz8Rina_i_BA4DiHbWi5uJHARliKKCLQ9bWm5OMzqPYG0GJYmEoWk1DF3Jf3hPKA1ByDUG50Auj5SC_W6xRzygcXC_aGNVGXdi37yy5CUhlwfgqPO_h1tovFOtnXt9OzQI3DvlgfiM3DWpL1P7o-Zgjo Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 5044e322520f485d942885c4ce6554b2 Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1486020065 Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:05:41.353810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:05:41.355487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5044e322520f485d942885c4ce6554b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5044e322520f485d942885c4ce6554b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5044e322520f485d942885c4ce6554b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5044e322520f485d942885c4ce6554b2", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:05:41.355487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1486020065 Oct 14 13:05:41.355487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 5044e322520f485d942885c4ce6554b2 Oct 14 13:05:41.355487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1486020065 Oct 14 13:05:41.355487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-VolumesSnapshotsTestJSON-1486020065-project Oct 14 13:05:41.355487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:05:41.355487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:05:41.355487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 5ceb0f3e22b246d8a3f5ced16295fa80 Oct 14 13:05:41.355487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1486020065-project Oct 14 13:05:41.355487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: Oct 14 13:05:41.355487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. Oct 14 13:05:41.355487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '3a3cd6d0-399f-4c29-82b0-ed9fb9872d94'} Oct 14 13:05:41.355487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. (HTTP 404) (Request-ID: req-dd1d5947-1755-472a-926e-c902264d565f) Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:41.356564 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 14 13:05:41.358227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 14 13:05:41.360063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:05:41.361454 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. Oct 14 13:05:41.361454 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.361454 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:41.361454 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.361454 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:41.361454 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:41.361454 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:41.361454 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:05:41.361454 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:05:41.361454 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. Oct 14 13:05:41.361454 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.363338 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-39b16527-c2cc-4341-80e3-dd11fefd77a9 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Returning 404 to user: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:05:41.364205 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-39b16527-c2cc-4341-80e3-dd11fefd77a9 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94" status: 404 len: 109 microversion: 2.1 time: 0.048331 Oct 14 13:05:41.364770 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 351/707] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Oct 14 13:05:41 2022] DELETE /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:05:41.373007 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6825dc7f-27bf-4695-878c-2700e7b048d6 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Calling method '.version_select at 0x7fbb819cf550>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:41.411125 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-6825dc7f-27bf-4695-878c-2700e7b048d6 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] HTTP exception thrown: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6825dc7f-27bf-4695-878c-2700e7b048d6 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Request method failure captured: Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 HTTP/1.1 Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV6dTtiQO3Rai44oUEL6qkOaz8Rina_i_BA4DiHbWi5uJHARliKKCLQ9bWm5OMzqPYG0GJYmEoWk1DF3Jf3hPKA1ByDUG50Auj5SC_W6xRzygcXC_aGNVGXdi37yy5CUhlwfgqPO_h1tovFOtnXt9OzQI3DvlgfiM3DWpL1P7o-Zgjo Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 5044e322520f485d942885c4ce6554b2 Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1486020065 Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:05:41.427520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:05:41.429679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5044e322520f485d942885c4ce6554b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5044e322520f485d942885c4ce6554b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5044e322520f485d942885c4ce6554b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5044e322520f485d942885c4ce6554b2", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:05:41.429679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1486020065 Oct 14 13:05:41.429679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 5044e322520f485d942885c4ce6554b2 Oct 14 13:05:41.429679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1486020065 Oct 14 13:05:41.429679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-VolumesSnapshotsTestJSON-1486020065-project Oct 14 13:05:41.429679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:05:41.429679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:05:41.429679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 5ceb0f3e22b246d8a3f5ced16295fa80 Oct 14 13:05:41.429679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1486020065-project Oct 14 13:05:41.429679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: Oct 14 13:05:41.429679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. Oct 14 13:05:41.429679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '3a3cd6d0-399f-4c29-82b0-ed9fb9872d94'} Oct 14 13:05:41.429679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. (HTTP 404) (Request-ID: req-a2251b59-5d6b-4c2a-8c38-ad8099461f96) Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:41.430573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 13:05:41.431714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 13:05:41.432994 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:05:41.435702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. Oct 14 13:05:41.435702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.435702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:41.435702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.435702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:41.435702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:41.435702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:41.435702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:05:41.435702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:05:41.435702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. Oct 14 13:05:41.435702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:41.435702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6825dc7f-27bf-4695-878c-2700e7b048d6 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] Returning 404 to user: Volume 3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:05:41.435702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-6825dc7f-27bf-4695-878c-2700e7b048d6 tempest-VolumesSnapshotsTestJSON-1486020065 tempest-VolumesSnapshotsTestJSON-1486020065-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94" status: 404 len: 109 microversion: 2.1 time: 0.052523 Oct 14 13:05:41.435702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 357/708] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Oct 14 13:05:41 2022] GET /compute/v2.1/os-volumes/3a3cd6d0-399f-4c29-82b0-ed9fb9872d94 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:05:41.722652 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7fa82c6b-2e13-4915-a0bb-f882c877d466 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:41.724289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7fa82c6b-2e13-4915-a0bb-f882c877d466 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:41.739644 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7fa82c6b-2e13-4915-a0bb-f882c877d466 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:41.740139 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7fa82c6b-2e13-4915-a0bb-f882c877d466 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:41.741741 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7fa82c6b-2e13-4915-a0bb-f882c877d466 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:41.743374 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7fa82c6b-2e13-4915-a0bb-f882c877d466 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:41.745707 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7fa82c6b-2e13-4915-a0bb-f882c877d466 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:41.746326 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7fa82c6b-2e13-4915-a0bb-f882c877d466 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:41.913135 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7fa82c6b-2e13-4915-a0bb-f882c877d466 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:41.927181 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7fa82c6b-2e13-4915-a0bb-f882c877d466 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:41.928705 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7fa82c6b-2e13-4915-a0bb-f882c877d466 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:41.929991 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7fa82c6b-2e13-4915-a0bb-f882c877d466 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.212692 Oct 14 13:05:41.930712 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 352/709] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:41 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:42.960224 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9fe72ced-659b-4625-ad45-03d48e9aee7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:42.962359 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-9fe72ced-659b-4625-ad45-03d48e9aee7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:42.965930 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:42.987056 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9fe72ced-659b-4625-ad45-03d48e9aee7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:42.987549 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9fe72ced-659b-4625-ad45-03d48e9aee7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:42.987959 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9fe72ced-659b-4625-ad45-03d48e9aee7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:42.988986 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9fe72ced-659b-4625-ad45-03d48e9aee7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:42.989445 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9fe72ced-659b-4625-ad45-03d48e9aee7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:42.989911 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9fe72ced-659b-4625-ad45-03d48e9aee7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:43.164765 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9fe72ced-659b-4625-ad45-03d48e9aee7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:43.173389 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9fe72ced-659b-4625-ad45-03d48e9aee7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:43.174867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9fe72ced-659b-4625-ad45-03d48e9aee7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:43.176056 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-9fe72ced-659b-4625-ad45-03d48e9aee7c tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.223372 Oct 14 13:05:43.176598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 358/710] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:42 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:44.204190 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ef5f0e67-8f99-4b33-873d-3d629e2b779d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:44.204803 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ef5f0e67-8f99-4b33-873d-3d629e2b779d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:44.212509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ef5f0e67-8f99-4b33-873d-3d629e2b779d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:44.212942 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ef5f0e67-8f99-4b33-873d-3d629e2b779d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:44.213381 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ef5f0e67-8f99-4b33-873d-3d629e2b779d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:44.214091 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ef5f0e67-8f99-4b33-873d-3d629e2b779d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:44.214549 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ef5f0e67-8f99-4b33-873d-3d629e2b779d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:44.215058 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ef5f0e67-8f99-4b33-873d-3d629e2b779d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:44.367483 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ef5f0e67-8f99-4b33-873d-3d629e2b779d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:44.375616 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ef5f0e67-8f99-4b33-873d-3d629e2b779d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:44.377104 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ef5f0e67-8f99-4b33-873d-3d629e2b779d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:44.378314 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ef5f0e67-8f99-4b33-873d-3d629e2b779d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.178104 Oct 14 13:05:44.378902 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 353/711] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:44 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:45.403163 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b850fcb9-4bd2-4fa5-9272-f37e47bde664 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:45.403772 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b850fcb9-4bd2-4fa5-9272-f37e47bde664 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:45.410190 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b850fcb9-4bd2-4fa5-9272-f37e47bde664 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:45.410673 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b850fcb9-4bd2-4fa5-9272-f37e47bde664 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:45.411106 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b850fcb9-4bd2-4fa5-9272-f37e47bde664 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:45.411789 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b850fcb9-4bd2-4fa5-9272-f37e47bde664 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:45.412239 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b850fcb9-4bd2-4fa5-9272-f37e47bde664 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:45.412839 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b850fcb9-4bd2-4fa5-9272-f37e47bde664 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:45.546582 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b850fcb9-4bd2-4fa5-9272-f37e47bde664 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:45.555609 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b850fcb9-4bd2-4fa5-9272-f37e47bde664 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:45.557077 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b850fcb9-4bd2-4fa5-9272-f37e47bde664 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:45.558538 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b850fcb9-4bd2-4fa5-9272-f37e47bde664 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.159081 Oct 14 13:05:45.569653 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 359/712] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:45 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:46.586788 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-501099c2-4e93-4ddf-bef2-4243bce6e4f8 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:46.587390 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-501099c2-4e93-4ddf-bef2-4243bce6e4f8 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:46.593833 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-501099c2-4e93-4ddf-bef2-4243bce6e4f8 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:46.594304 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-501099c2-4e93-4ddf-bef2-4243bce6e4f8 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:46.594728 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-501099c2-4e93-4ddf-bef2-4243bce6e4f8 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:46.595398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-501099c2-4e93-4ddf-bef2-4243bce6e4f8 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:46.595840 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-501099c2-4e93-4ddf-bef2-4243bce6e4f8 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:46.596253 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-501099c2-4e93-4ddf-bef2-4243bce6e4f8 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:46.724385 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-501099c2-4e93-4ddf-bef2-4243bce6e4f8 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:46.734088 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-501099c2-4e93-4ddf-bef2-4243bce6e4f8 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:46.735869 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-501099c2-4e93-4ddf-bef2-4243bce6e4f8 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:46.737043 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-501099c2-4e93-4ddf-bef2-4243bce6e4f8 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.154705 Oct 14 13:05:46.737617 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 354/713] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:46 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:47.596728 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-55b3894e-bc56-4195-9959-d00c9d1bd31a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:47.597225 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-55b3894e-bc56-4195-9959-d00c9d1bd31a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:47.604120 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-55b3894e-bc56-4195-9959-d00c9d1bd31a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:47.604601 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-55b3894e-bc56-4195-9959-d00c9d1bd31a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:47.605038 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-55b3894e-bc56-4195-9959-d00c9d1bd31a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:47.605751 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-55b3894e-bc56-4195-9959-d00c9d1bd31a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:47.606206 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-55b3894e-bc56-4195-9959-d00c9d1bd31a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:47.606631 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-55b3894e-bc56-4195-9959-d00c9d1bd31a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:47.686503 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.objects.instance [None req-55b3894e-bc56-4195-9959-d00c9d1bd31a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lazy-loading 'services' on Instance uuid 5a62f4f4-9e85-4d89-9580-445a0369cadc {{(pid=118868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:05:47.758020 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-55b3894e-bc56-4195-9959-d00c9d1bd31a tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/os-volume_attachments/5aa7edc7-ebc7-488c-8f75-ad4987f646ee" status: 202 len: 0 microversion: 2.1 time: 0.164901 Oct 14 13:05:47.758664 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 360/714] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Oct 14 13:05:47 2022] DELETE /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/os-volume_attachments/5aa7edc7-ebc7-488c-8f75-ad4987f646ee => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:05:47.766183 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-140fab05-6be6-46e5-9126-9c91d07e03ec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:47.766796 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-140fab05-6be6-46e5-9126-9c91d07e03ec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:47.767177 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c7769918-8a22-40f2-bf56-0479cb85b1b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:47.769561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c7769918-8a22-40f2-bf56-0479cb85b1b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:47.773829 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-140fab05-6be6-46e5-9126-9c91d07e03ec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:47.774322 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-140fab05-6be6-46e5-9126-9c91d07e03ec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:47.774781 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-140fab05-6be6-46e5-9126-9c91d07e03ec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:47.775469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-140fab05-6be6-46e5-9126-9c91d07e03ec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:47.775671 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7769918-8a22-40f2-bf56-0479cb85b1b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:47.775915 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-140fab05-6be6-46e5-9126-9c91d07e03ec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:47.776160 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7769918-8a22-40f2-bf56-0479cb85b1b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:47.776340 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-140fab05-6be6-46e5-9126-9c91d07e03ec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:47.776628 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7769918-8a22-40f2-bf56-0479cb85b1b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:47.777321 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7769918-8a22-40f2-bf56-0479cb85b1b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:47.777812 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7769918-8a22-40f2-bf56-0479cb85b1b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:47.778241 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c7769918-8a22-40f2-bf56-0479cb85b1b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:47.807858 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c7769918-8a22-40f2-bf56-0479cb85b1b9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Oct 14 13:05:47.808421 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 361/715] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:05:47 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:05:47.907184 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-140fab05-6be6-46e5-9126-9c91d07e03ec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:47.915724 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-140fab05-6be6-46e5-9126-9c91d07e03ec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:47.917175 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-140fab05-6be6-46e5-9126-9c91d07e03ec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:47.918361 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-140fab05-6be6-46e5-9126-9c91d07e03ec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.156084 Oct 14 13:05:47.918926 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 355/716] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:47 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:48.821125 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0206735f-2c8a-4479-ba2f-4affb1320c97 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:48.823274 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0206735f-2c8a-4479-ba2f-4affb1320c97 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:48.829588 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0206735f-2c8a-4479-ba2f-4affb1320c97 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:48.830066 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0206735f-2c8a-4479-ba2f-4affb1320c97 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:48.830492 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0206735f-2c8a-4479-ba2f-4affb1320c97 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:48.831167 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0206735f-2c8a-4479-ba2f-4affb1320c97 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:48.831618 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0206735f-2c8a-4479-ba2f-4affb1320c97 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:48.832035 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0206735f-2c8a-4479-ba2f-4affb1320c97 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:48.860871 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0206735f-2c8a-4479-ba2f-4affb1320c97 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Oct 14 13:05:48.861407 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 362/717] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:05:48 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:48.944040 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-af021694-f0ee-4d0e-af34-4d9b3a7fc98b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:48.944642 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-af021694-f0ee-4d0e-af34-4d9b3a7fc98b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:48.951604 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af021694-f0ee-4d0e-af34-4d9b3a7fc98b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:48.952079 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af021694-f0ee-4d0e-af34-4d9b3a7fc98b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:48.952507 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af021694-f0ee-4d0e-af34-4d9b3a7fc98b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:48.953185 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af021694-f0ee-4d0e-af34-4d9b3a7fc98b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:48.953662 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af021694-f0ee-4d0e-af34-4d9b3a7fc98b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:48.954174 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af021694-f0ee-4d0e-af34-4d9b3a7fc98b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:49.083093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-af021694-f0ee-4d0e-af34-4d9b3a7fc98b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:49.091095 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-af021694-f0ee-4d0e-af34-4d9b3a7fc98b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:49.092530 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-af021694-f0ee-4d0e-af34-4d9b3a7fc98b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:49.093697 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-af021694-f0ee-4d0e-af34-4d9b3a7fc98b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.153451 Oct 14 13:05:49.094244 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 356/718] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:48 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:49.873669 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5b64015f-afaa-4a81-a8bf-297f4a433b73 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:49.875817 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5b64015f-afaa-4a81-a8bf-297f4a433b73 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:49.882091 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b64015f-afaa-4a81-a8bf-297f4a433b73 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:49.883082 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b64015f-afaa-4a81-a8bf-297f4a433b73 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:49.883497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b64015f-afaa-4a81-a8bf-297f4a433b73 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:49.884174 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b64015f-afaa-4a81-a8bf-297f4a433b73 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:49.884620 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b64015f-afaa-4a81-a8bf-297f4a433b73 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:49.885035 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b64015f-afaa-4a81-a8bf-297f4a433b73 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:49.918160 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5b64015f-afaa-4a81-a8bf-297f4a433b73 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048447 Oct 14 13:05:49.922928 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 363/719] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:05:49 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:05:50.119499 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-baf0af9a-de37-4af6-88f1-4baee983b5d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:50.120101 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-baf0af9a-de37-4af6-88f1-4baee983b5d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:50.122573 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:50.127854 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-baf0af9a-de37-4af6-88f1-4baee983b5d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:50.128340 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-baf0af9a-de37-4af6-88f1-4baee983b5d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:50.128779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-baf0af9a-de37-4af6-88f1-4baee983b5d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:50.129529 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-baf0af9a-de37-4af6-88f1-4baee983b5d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:50.130168 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-baf0af9a-de37-4af6-88f1-4baee983b5d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:50.130589 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-baf0af9a-de37-4af6-88f1-4baee983b5d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:50.292571 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-baf0af9a-de37-4af6-88f1-4baee983b5d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:50.300778 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-baf0af9a-de37-4af6-88f1-4baee983b5d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:50.302384 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-baf0af9a-de37-4af6-88f1-4baee983b5d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:50.303378 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-baf0af9a-de37-4af6-88f1-4baee983b5d2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.187998 Oct 14 13:05:50.303930 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 357/720] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:50 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:50.932603 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-a87efbd9-15fc-49b5-8ee1-29e0fd294872 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:50.935492 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-a87efbd9-15fc-49b5-8ee1-29e0fd294872 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:50.942643 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a87efbd9-15fc-49b5-8ee1-29e0fd294872 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:50.943252 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a87efbd9-15fc-49b5-8ee1-29e0fd294872 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:50.943807 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a87efbd9-15fc-49b5-8ee1-29e0fd294872 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:50.944697 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a87efbd9-15fc-49b5-8ee1-29e0fd294872 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:50.945156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a87efbd9-15fc-49b5-8ee1-29e0fd294872 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:50.945735 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a87efbd9-15fc-49b5-8ee1-29e0fd294872 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:50.988369 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-a87efbd9-15fc-49b5-8ee1-29e0fd294872 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061318 Oct 14 13:05:50.989026 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 364/721] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:05:50 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 13:05:51.055459 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f4a4b461-a70d-4221-84c6-c266e30b31d3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:51.056375 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f4a4b461-a70d-4221-84c6-c266e30b31d3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:51.063040 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f4a4b461-a70d-4221-84c6-c266e30b31d3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:51.063507 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f4a4b461-a70d-4221-84c6-c266e30b31d3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:51.063931 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f4a4b461-a70d-4221-84c6-c266e30b31d3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:51.064784 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f4a4b461-a70d-4221-84c6-c266e30b31d3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:51.065240 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f4a4b461-a70d-4221-84c6-c266e30b31d3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:51.065728 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f4a4b461-a70d-4221-84c6-c266e30b31d3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:51.091723 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f4a4b461-a70d-4221-84c6-c266e30b31d3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Going to try to terminate instance {{(pid=118869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:05:51.171631 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-f4a4b461-a70d-4221-84c6-c266e30b31d3 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 204 len: 0 microversion: 2.1 time: 0.119961 Oct 14 13:05:51.172572 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 358/722] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:05:51 2022] DELETE /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:05:51.180635 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2ca41030-b652-4b39-892d-f746b14d495e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:51.181572 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2ca41030-b652-4b39-892d-f746b14d495e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:51.187729 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ca41030-b652-4b39-892d-f746b14d495e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:51.188218 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ca41030-b652-4b39-892d-f746b14d495e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:51.188651 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ca41030-b652-4b39-892d-f746b14d495e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:51.189336 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ca41030-b652-4b39-892d-f746b14d495e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:51.190006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ca41030-b652-4b39-892d-f746b14d495e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:51.190583 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ca41030-b652-4b39-892d-f746b14d495e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:51.332715 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-aade59ca-d75c-4c2a-9728-e8ea7285f26f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:51.333394 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2ca41030-b652-4b39-892d-f746b14d495e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:51.334027 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-aade59ca-d75c-4c2a-9728-e8ea7285f26f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:51.342391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2ca41030-b652-4b39-892d-f746b14d495e tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 200 len: 1681 microversion: 2.1 time: 0.165703 Oct 14 13:05:51.342998 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-aade59ca-d75c-4c2a-9728-e8ea7285f26f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:51.343331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 365/723] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:51 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:51.346269 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-aade59ca-d75c-4c2a-9728-e8ea7285f26f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:51.347333 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-aade59ca-d75c-4c2a-9728-e8ea7285f26f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:51.348119 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-aade59ca-d75c-4c2a-9728-e8ea7285f26f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:51.348650 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-aade59ca-d75c-4c2a-9728-e8ea7285f26f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:51.349144 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-aade59ca-d75c-4c2a-9728-e8ea7285f26f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:51.487313 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-aade59ca-d75c-4c2a-9728-e8ea7285f26f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:51.491124 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:51.496909 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-aade59ca-d75c-4c2a-9728-e8ea7285f26f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:51.498412 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-aade59ca-d75c-4c2a-9728-e8ea7285f26f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:51.499572 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-aade59ca-d75c-4c2a-9728-e8ea7285f26f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.171806 Oct 14 13:05:51.500126 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 359/724] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:51 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:05:52.074795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-1847071a-8a85-4f16-a107-29b9ca8ccfc9 req-b0193434-38d4-4d37-9bac-b246f2ed4ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bff20a0-76b8-44e6-9f5c-87a9fce18f87", "name": "network-vif-plugged", "status": "completed", "tag": "096cc001-9ca8-472a-8f3d-2a345a805218"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:05:52.097019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-1847071a-8a85-4f16-a107-29b9ca8ccfc9 req-b0193434-38d4-4d37-9bac-b246f2ed4ed3 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:52.098258 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-1847071a-8a85-4f16-a107-29b9ca8ccfc9 req-b0193434-38d4-4d37-9bac-b246f2ed4ed3 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:52.098702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-1847071a-8a85-4f16-a107-29b9ca8ccfc9 req-b0193434-38d4-4d37-9bac-b246f2ed4ed3 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:52.115861 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-1847071a-8a85-4f16-a107-29b9ca8ccfc9 req-b0193434-38d4-4d37-9bac-b246f2ed4ed3 service nova] Creating event network-vif-plugged:096cc001-9ca8-472a-8f3d-2a345a805218 for instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 on hv-cinder-82099 Oct 14 13:05:52.123106 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-1847071a-8a85-4f16-a107-29b9ca8ccfc9 req-b0193434-38d4-4d37-9bac-b246f2ed4ed3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053220 Oct 14 13:05:52.123688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 366/725] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:52.366476 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-307a6e2a-c80b-445a-a852-37b1102652cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:52.367517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-307a6e2a-c80b-445a-a852-37b1102652cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:52.374815 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-307a6e2a-c80b-445a-a852-37b1102652cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:52.375305 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-307a6e2a-c80b-445a-a852-37b1102652cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:52.375745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-307a6e2a-c80b-445a-a852-37b1102652cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:52.379594 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-307a6e2a-c80b-445a-a852-37b1102652cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:52.379594 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-307a6e2a-c80b-445a-a852-37b1102652cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:52.379594 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-307a6e2a-c80b-445a-a852-37b1102652cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:52.517580 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-307a6e2a-c80b-445a-a852-37b1102652cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:52.526716 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c028d01e-ece6-498a-90e6-62cf0c803cec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:52.527710 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c028d01e-ece6-498a-90e6-62cf0c803cec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:52.529247 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-307a6e2a-c80b-445a-a852-37b1102652cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 200 len: 1681 microversion: 2.1 time: 0.166484 Oct 14 13:05:52.530162 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 360/726] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:52 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:52.534754 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c028d01e-ece6-498a-90e6-62cf0c803cec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:52.534754 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c028d01e-ece6-498a-90e6-62cf0c803cec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:52.535218 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c028d01e-ece6-498a-90e6-62cf0c803cec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:52.535912 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c028d01e-ece6-498a-90e6-62cf0c803cec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:52.536444 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c028d01e-ece6-498a-90e6-62cf0c803cec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:52.536789 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c028d01e-ece6-498a-90e6-62cf0c803cec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:52.672758 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c028d01e-ece6-498a-90e6-62cf0c803cec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:52.681147 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c028d01e-ece6-498a-90e6-62cf0c803cec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:52.683159 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c028d01e-ece6-498a-90e6-62cf0c803cec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:52.684359 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c028d01e-ece6-498a-90e6-62cf0c803cec tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.162627 Oct 14 13:05:52.684926 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 367/727] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:52 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:05:53.557251 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ff500869-d59b-4d25-a1aa-60b34d6f42a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:53.557897 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ff500869-d59b-4d25-a1aa-60b34d6f42a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:53.570698 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ff500869-d59b-4d25-a1aa-60b34d6f42a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:53.590096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ff500869-d59b-4d25-a1aa-60b34d6f42a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:53.592353 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ff500869-d59b-4d25-a1aa-60b34d6f42a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:53.593428 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ff500869-d59b-4d25-a1aa-60b34d6f42a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:53.594824 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ff500869-d59b-4d25-a1aa-60b34d6f42a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:53.595602 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ff500869-d59b-4d25-a1aa-60b34d6f42a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:53.711483 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-be0ced11-c95c-43ca-9722-64fc2f236c94 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:53.712745 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-be0ced11-c95c-43ca-9722-64fc2f236c94 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:53.722647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-be0ced11-c95c-43ca-9722-64fc2f236c94 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:53.723208 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-be0ced11-c95c-43ca-9722-64fc2f236c94 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:53.724067 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-be0ced11-c95c-43ca-9722-64fc2f236c94 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:53.725103 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-be0ced11-c95c-43ca-9722-64fc2f236c94 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:53.725773 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-be0ced11-c95c-43ca-9722-64fc2f236c94 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:53.726293 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-be0ced11-c95c-43ca-9722-64fc2f236c94 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:53.842822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ff500869-d59b-4d25-a1aa-60b34d6f42a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:53.854977 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ff500869-d59b-4d25-a1aa-60b34d6f42a2 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 200 len: 1681 microversion: 2.1 time: 0.304100 Oct 14 13:05:53.855565 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 361/728] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:53 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 1681 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:54.048598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-be0ced11-c95c-43ca-9722-64fc2f236c94 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:54.055530 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:05:54.066946 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-be0ced11-c95c-43ca-9722-64fc2f236c94 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:54.070896 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-be0ced11-c95c-43ca-9722-64fc2f236c94 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:54.080623 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-be0ced11-c95c-43ca-9722-64fc2f236c94 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.373294 Oct 14 13:05:54.084329 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 368/729] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:53 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:54.465021 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-86b3798a-ef74-4a27-ab00-f371037dcc0d req-9161cf38-e9af-49c1-99c4-3ad02a01a08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a62f4f4-9e85-4d89-9580-445a0369cadc", "name": "network-vif-deleted", "tag": "5d64d93f-8984-45dd-b22b-857d5d14a329"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:05:54.492751 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-86b3798a-ef74-4a27-ab00-f371037dcc0d req-9161cf38-e9af-49c1-99c4-3ad02a01a08b service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:54.494356 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-86b3798a-ef74-4a27-ab00-f371037dcc0d req-9161cf38-e9af-49c1-99c4-3ad02a01a08b service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:54.496448 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-86b3798a-ef74-4a27-ab00-f371037dcc0d req-9161cf38-e9af-49c1-99c4-3ad02a01a08b service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:54.530700 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-86b3798a-ef74-4a27-ab00-f371037dcc0d req-9161cf38-e9af-49c1-99c4-3ad02a01a08b service nova] Creating event network-vif-deleted:5d64d93f-8984-45dd-b22b-857d5d14a329 for instance 5a62f4f4-9e85-4d89-9580-445a0369cadc on hv-cinder-82099 Oct 14 13:05:54.543736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-86b3798a-ef74-4a27-ab00-f371037dcc0d req-9161cf38-e9af-49c1-99c4-3ad02a01a08b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087953 Oct 14 13:05:54.544510 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 362/730] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:05:54.884316 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b4a534d2-b1c3-42f8-b878-1e3d1d1e88a9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:54.885680 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b4a534d2-b1c3-42f8-b878-1e3d1d1e88a9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:54.900237 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b4a534d2-b1c3-42f8-b878-1e3d1d1e88a9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:54.903017 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b4a534d2-b1c3-42f8-b878-1e3d1d1e88a9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:54.904136 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b4a534d2-b1c3-42f8-b878-1e3d1d1e88a9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:54.905676 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b4a534d2-b1c3-42f8-b878-1e3d1d1e88a9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:54.906422 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b4a534d2-b1c3-42f8-b878-1e3d1d1e88a9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:54.907069 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b4a534d2-b1c3-42f8-b878-1e3d1d1e88a9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:54.984339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b4a534d2-b1c3-42f8-b878-1e3d1d1e88a9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:54.985258 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b4a534d2-b1c3-42f8-b878-1e3d1d1e88a9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:54.985815 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b4a534d2-b1c3-42f8-b878-1e3d1d1e88a9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:54.987822 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.objects.instance [None req-b4a534d2-b1c3-42f8-b878-1e3d1d1e88a9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lazy-loading 'fault' on Instance uuid 5a62f4f4-9e85-4d89-9580-445a0369cadc {{(pid=118868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:05:55.079656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b4a534d2-b1c3-42f8-b878-1e3d1d1e88a9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcbf6513b6a4df3b044fadfb7888d54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0d083e8cef4333b9514d2256991647', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:55.095313 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b4a534d2-b1c3-42f8-b878-1e3d1d1e88a9 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 200 len: 1331 microversion: 2.1 time: 0.216805 Oct 14 13:05:55.097215 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 369/731] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:54 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 1331 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:05:55.499035 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2be18d25-7c92-4e78-86ab-06eba646fe66 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:55.500986 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-2be18d25-7c92-4e78-86ab-06eba646fe66 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:55.510073 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2be18d25-7c92-4e78-86ab-06eba646fe66 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:55.510894 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2be18d25-7c92-4e78-86ab-06eba646fe66 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:55.512193 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2be18d25-7c92-4e78-86ab-06eba646fe66 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:55.513067 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2be18d25-7c92-4e78-86ab-06eba646fe66 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:55.514719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2be18d25-7c92-4e78-86ab-06eba646fe66 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:55.515162 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2be18d25-7c92-4e78-86ab-06eba646fe66 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:55.776832 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-2be18d25-7c92-4e78-86ab-06eba646fe66 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:55.786937 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-2be18d25-7c92-4e78-86ab-06eba646fe66 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:55.789209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-2be18d25-7c92-4e78-86ab-06eba646fe66 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:55.790465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-2be18d25-7c92-4e78-86ab-06eba646fe66 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1732 microversion: 2.20 time: 0.682264 Oct 14 13:05:55.791522 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 363/732] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:55 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1732 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:56.121435 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2abfe7ca-48f2-4b44-9116-303f8c013f29 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:56.122439 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2abfe7ca-48f2-4b44-9116-303f8c013f29 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:56.130891 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2abfe7ca-48f2-4b44-9116-303f8c013f29 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:56.131392 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2abfe7ca-48f2-4b44-9116-303f8c013f29 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:56.131835 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2abfe7ca-48f2-4b44-9116-303f8c013f29 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:56.135208 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2abfe7ca-48f2-4b44-9116-303f8c013f29 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:56.135697 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2abfe7ca-48f2-4b44-9116-303f8c013f29 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:56.136126 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2abfe7ca-48f2-4b44-9116-303f8c013f29 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:56.160374 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-2abfe7ca-48f2-4b44-9116-303f8c013f29 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] HTTP exception thrown: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2abfe7ca-48f2-4b44-9116-303f8c013f29 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Request method failure captured: Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc HTTP/1.1 Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV1FViMK-WvBvO8SLI8drD1UcXlTPANFWG-ZTvaw7ModKJdGRWngdLI5cp6n7bXZ7oPe4LkLOonqm901dlPL1Z_CDQlnflfzMT4YPNiiBNZ_K890mBj2sVo-ptm5duO44Ujpzx_OuaK4ZxTnFio58yttRWo_3AshSXsX0p_7cyovml4 Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:05:56.168804 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:05:56.170633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c0d083e8cef4333b9514d2256991647", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:05:56.170633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:05:56.170633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:05:56.170633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:05:56.170633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:05:56.170633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:05:56.170633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:05:56.170633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 0bcbf6513b6a4df3b044fadfb7888d54 Oct 14 13:05:56.170633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:05:56.170633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:05:56.170633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. Oct 14 13:05:56.170633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '5a62f4f4-9e85-4d89-9580-445a0369cadc'} Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:05:56.171488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. Oct 14 13:05:56.172932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:56.180681 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2abfe7ca-48f2-4b44-9116-303f8c013f29 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Returning 404 to user: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:05:56.183833 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2abfe7ca-48f2-4b44-9116-303f8c013f29 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 404 len: 111 microversion: 2.1 time: 0.064279 Oct 14 13:05:56.189141 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 370/733] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:56 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:05:56.193882 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-fd5c42fe-4a0a-4be4-a91a-3e87eebcd78f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '.version_select at 0x7fbb81a32a60>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:56.230098 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-fd5c42fe-4a0a-4be4-a91a-3e87eebcd78f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-601436065" status: 202 len: 0 microversion: 2.1 time: 0.040458 Oct 14 13:05:56.234618 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 364/734] 10.222.0.47 () {58 vars in 1218 bytes} [Fri Oct 14 13:05:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-601436065 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:05:56.816283 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-eefeca57-6085-4ca5-8449-23fcc11d0fef tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:56.817173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-eefeca57-6085-4ca5-8449-23fcc11d0fef tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:56.835128 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eefeca57-6085-4ca5-8449-23fcc11d0fef tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:56.836633 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eefeca57-6085-4ca5-8449-23fcc11d0fef tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:56.837232 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eefeca57-6085-4ca5-8449-23fcc11d0fef tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:56.838120 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eefeca57-6085-4ca5-8449-23fcc11d0fef tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:56.838735 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eefeca57-6085-4ca5-8449-23fcc11d0fef tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:56.839340 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eefeca57-6085-4ca5-8449-23fcc11d0fef tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:57.427958 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-eefeca57-6085-4ca5-8449-23fcc11d0fef tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:57.442085 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-eefeca57-6085-4ca5-8449-23fcc11d0fef tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:57.445687 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-eefeca57-6085-4ca5-8449-23fcc11d0fef tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:05:57.448326 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-eefeca57-6085-4ca5-8449-23fcc11d0fef tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1719 microversion: 2.20 time: 0.634505 Oct 14 13:05:57.448918 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 371/735] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:05:56 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1719 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:05:58.843227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-9ddf7b80-e6f2-4b3e-8df4-9d6bc6cddd67 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:58.843798 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-9ddf7b80-e6f2-4b3e-8df4-9d6bc6cddd67 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:58.851666 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9ddf7b80-e6f2-4b3e-8df4-9d6bc6cddd67 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:58.852147 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9ddf7b80-e6f2-4b3e-8df4-9d6bc6cddd67 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:58.852817 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9ddf7b80-e6f2-4b3e-8df4-9d6bc6cddd67 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:58.853521 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9ddf7b80-e6f2-4b3e-8df4-9d6bc6cddd67 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:58.854048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9ddf7b80-e6f2-4b3e-8df4-9d6bc6cddd67 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:58.854671 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9ddf7b80-e6f2-4b3e-8df4-9d6bc6cddd67 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:58.869170 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-9ddf7b80-e6f2-4b3e-8df4-9d6bc6cddd67 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] HTTP exception thrown: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-9ddf7b80-e6f2-4b3e-8df4-9d6bc6cddd67 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Request method failure captured: Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: DELETE /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc HTTP/1.1 Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1FViMK-WvBvO8SLI8drD1UcXlTPANFWG-ZTvaw7ModKJdGRWngdLI5cp6n7bXZ7oPe4LkLOonqm901dlPL1Z_CDQlnflfzMT4YPNiiBNZ_K890mBj2sVo-ptm5duO44Ujpzx_OuaK4ZxTnFio58yttRWo_3AshSXsX0p_7cyovml4 Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:05:58.871158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:05:58.872559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c0d083e8cef4333b9514d2256991647", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:05:58.872559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:05:58.872559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:05:58.872559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:05:58.872559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:05:58.872559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:05:58.872559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:05:58.872559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 0bcbf6513b6a4df3b044fadfb7888d54 Oct 14 13:05:58.872559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:05:58.872559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:05:58.872559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. Oct 14 13:05:58.872559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '5a62f4f4-9e85-4d89-9580-445a0369cadc'} Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:05:58.873307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. Oct 14 13:05:58.874586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:05:58.875827 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-9ddf7b80-e6f2-4b3e-8df4-9d6bc6cddd67 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Returning 404 to user: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:05:58.875827 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-9ddf7b80-e6f2-4b3e-8df4-9d6bc6cddd67 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 404 len: 111 microversion: 2.1 time: 0.033186 Oct 14 13:05:58.875827 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 365/736] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:05:58 2022] DELETE /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:05:58.882569 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6589a680-491d-4c44-ba09-6e953c13eaeb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:05:58.883335 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-6589a680-491d-4c44-ba09-6e953c13eaeb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5a62f4f4-9e85-4d89-9580-445a0369cadc] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:05:58.890291 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6589a680-491d-4c44-ba09-6e953c13eaeb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:58.891005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6589a680-491d-4c44-ba09-6e953c13eaeb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:58.891438 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6589a680-491d-4c44-ba09-6e953c13eaeb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:58.892134 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6589a680-491d-4c44-ba09-6e953c13eaeb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:05:58.892888 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6589a680-491d-4c44-ba09-6e953c13eaeb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:05:58.893316 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6589a680-491d-4c44-ba09-6e953c13eaeb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:05:58.908373 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-6589a680-491d-4c44-ba09-6e953c13eaeb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] HTTP exception thrown: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6589a680-491d-4c44-ba09-6e953c13eaeb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Request method failure captured: Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc HTTP/1.1 Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV1FViMK-WvBvO8SLI8drD1UcXlTPANFWG-ZTvaw7ModKJdGRWngdLI5cp6n7bXZ7oPe4LkLOonqm901dlPL1Z_CDQlnflfzMT4YPNiiBNZ_K890mBj2sVo-ptm5duO44Ujpzx_OuaK4ZxTnFio58yttRWo_3AshSXsX0p_7cyovml4 Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:05:58.910183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:05:58.911527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c0d083e8cef4333b9514d2256991647", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:05:58.911527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:05:58.911527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:05:58.911527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:05:58.911527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:05:58.911527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:05:58.911527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:05:58.911527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 0bcbf6513b6a4df3b044fadfb7888d54 Oct 14 13:05:58.911527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:05:58.911527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:05:58.911527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. Oct 14 13:05:58.911527 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '5a62f4f4-9e85-4d89-9580-445a0369cadc'} Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:05:58.912361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. Oct 14 13:05:58.914189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:05:58.916005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6589a680-491d-4c44-ba09-6e953c13eaeb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Returning 404 to user: Instance 5a62f4f4-9e85-4d89-9580-445a0369cadc could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:05:58.916005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-6589a680-491d-4c44-ba09-6e953c13eaeb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc" status: 404 len: 111 microversion: 2.1 time: 0.033464 Oct 14 13:05:58.916005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 372/737] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:05:58 2022] GET /compute/v2.1/servers/5a62f4f4-9e85-4d89-9580-445a0369cadc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:06:00.103886 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f42dafdd-5a91-4982-8704-46c0d41c312b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:00.104395 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f42dafdd-5a91-4982-8704-46c0d41c312b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:00.111289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f42dafdd-5a91-4982-8704-46c0d41c312b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:00.111770 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f42dafdd-5a91-4982-8704-46c0d41c312b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:00.112200 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f42dafdd-5a91-4982-8704-46c0d41c312b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:00.112888 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f42dafdd-5a91-4982-8704-46c0d41c312b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:00.113332 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f42dafdd-5a91-4982-8704-46c0d41c312b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:00.113801 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f42dafdd-5a91-4982-8704-46c0d41c312b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:00.127918 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-f42dafdd-5a91-4982-8704-46c0d41c312b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] HTTP exception thrown: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f42dafdd-5a91-4982-8704-46c0d41c312b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Request method failure captured: Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: DELETE /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 HTTP/1.1 Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1FViMK-WvBvO8SLI8drD1UcXlTPANFWG-ZTvaw7ModKJdGRWngdLI5cp6n7bXZ7oPe4LkLOonqm901dlPL1Z_CDQlnflfzMT4YPNiiBNZ_K890mBj2sVo-ptm5duO44Ujpzx_OuaK4ZxTnFio58yttRWo_3AshSXsX0p_7cyovml4 Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:06:00.129658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:06:00.131150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c0d083e8cef4333b9514d2256991647", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:06:00.131150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:00.131150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:06:00.131150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:00.131150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:06:00.131150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:06:00.131150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:06:00.131150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 0bcbf6513b6a4df3b044fadfb7888d54 Oct 14 13:06:00.131150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:06:00.131150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:06:00.131150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. Oct 14 13:06:00.131150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '083c9d37-dbbe-48e2-9fdf-c23648f93a76'} Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:06:00.132990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. Oct 14 13:06:00.134289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.137988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f42dafdd-5a91-4982-8704-46c0d41c312b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Returning 404 to user: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:06:00.137988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-f42dafdd-5a91-4982-8704-46c0d41c312b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "DELETE /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 404 len: 111 microversion: 2.1 time: 0.031194 Oct 14 13:06:00.137988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 366/738] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:06:00 2022] DELETE /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 13:06:00.144227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-51d5bd68-936b-4460-9edd-75d76642c13b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:00.144849 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-51d5bd68-936b-4460-9edd-75d76642c13b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 083c9d37-dbbe-48e2-9fdf-c23648f93a76] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:00.151639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-51d5bd68-936b-4460-9edd-75d76642c13b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:00.152117 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-51d5bd68-936b-4460-9edd-75d76642c13b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:00.152555 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-51d5bd68-936b-4460-9edd-75d76642c13b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:00.153255 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-51d5bd68-936b-4460-9edd-75d76642c13b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:00.153759 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-51d5bd68-936b-4460-9edd-75d76642c13b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:00.154184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-51d5bd68-936b-4460-9edd-75d76642c13b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:00.168891 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-51d5bd68-936b-4460-9edd-75d76642c13b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] HTTP exception thrown: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-51d5bd68-936b-4460-9edd-75d76642c13b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Request method failure captured: Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 HTTP/1.1 Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV1FViMK-WvBvO8SLI8drD1UcXlTPANFWG-ZTvaw7ModKJdGRWngdLI5cp6n7bXZ7oPe4LkLOonqm901dlPL1Z_CDQlnflfzMT4YPNiiBNZ_K890mBj2sVo-ptm5duO44Ujpzx_OuaK4ZxTnFio58yttRWo_3AshSXsX0p_7cyovml4 Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:06:00.174222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:06:00.175656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c0d083e8cef4333b9514d2256991647", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:06:00.175656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:00.175656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:06:00.175656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:00.175656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:06:00.175656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:06:00.175656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:06:00.175656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 0bcbf6513b6a4df3b044fadfb7888d54 Oct 14 13:06:00.175656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:06:00.175656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:06:00.175656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. Oct 14 13:06:00.175656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '083c9d37-dbbe-48e2-9fdf-c23648f93a76'} Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:06:00.179961 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. Oct 14 13:06:00.181151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.182485 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-51d5bd68-936b-4460-9edd-75d76642c13b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Returning 404 to user: Instance 083c9d37-dbbe-48e2-9fdf-c23648f93a76 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:06:00.182485 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-51d5bd68-936b-4460-9edd-75d76642c13b tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76" status: 404 len: 111 microversion: 2.1 time: 0.035580 Oct 14 13:06:00.182485 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 373/739] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:00 2022] GET /compute/v2.1/servers/083c9d37-dbbe-48e2-9fdf-c23648f93a76 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:06:00.187707 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-80636361-bc1d-487a-adf6-ec8a2de755cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:00.188265 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-80636361-bc1d-487a-adf6-ec8a2de755cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:00.196967 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-80636361-bc1d-487a-adf6-ec8a2de755cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:00.197467 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-80636361-bc1d-487a-adf6-ec8a2de755cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:00.198452 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-80636361-bc1d-487a-adf6-ec8a2de755cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:00.199159 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-80636361-bc1d-487a-adf6-ec8a2de755cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:00.199891 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-80636361-bc1d-487a-adf6-ec8a2de755cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:00.200325 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-80636361-bc1d-487a-adf6-ec8a2de755cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:00.216259 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-80636361-bc1d-487a-adf6-ec8a2de755cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] HTTP exception thrown: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-80636361-bc1d-487a-adf6-ec8a2de755cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Request method failure captured: Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: DELETE /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee HTTP/1.1 Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1FViMK-WvBvO8SLI8drD1UcXlTPANFWG-ZTvaw7ModKJdGRWngdLI5cp6n7bXZ7oPe4LkLOonqm901dlPL1Z_CDQlnflfzMT4YPNiiBNZ_K890mBj2sVo-ptm5duO44Ujpzx_OuaK4ZxTnFio58yttRWo_3AshSXsX0p_7cyovml4 Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:06:00.217831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:06:00.219239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c0d083e8cef4333b9514d2256991647", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:06:00.219239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:00.219239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:06:00.219239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:00.219239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:06:00.219239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:06:00.219239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:06:00.219239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 0bcbf6513b6a4df3b044fadfb7888d54 Oct 14 13:06:00.219239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:06:00.219239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:06:00.219239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. Oct 14 13:06:00.219239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '5fe0d2ae-312a-4c18-96d6-ae8d86372eee'} Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:06:00.220000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. Oct 14 13:06:00.221309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.224274 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-80636361-bc1d-487a-adf6-ec8a2de755cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Returning 404 to user: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:06:00.224274 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-80636361-bc1d-487a-adf6-ec8a2de755cb tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 404 len: 111 microversion: 2.1 time: 0.036969 Oct 14 13:06:00.224274 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 367/740] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:06:00 2022] DELETE /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:06:00.230813 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-64fbb5e8-4159-4b1d-b9df-79ab2a79fd9f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:00.231611 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-64fbb5e8-4159-4b1d-b9df-79ab2a79fd9f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: 5fe0d2ae-312a-4c18-96d6-ae8d86372eee] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:00.238917 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64fbb5e8-4159-4b1d-b9df-79ab2a79fd9f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:00.239415 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64fbb5e8-4159-4b1d-b9df-79ab2a79fd9f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:00.240242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64fbb5e8-4159-4b1d-b9df-79ab2a79fd9f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:00.240969 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64fbb5e8-4159-4b1d-b9df-79ab2a79fd9f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:00.241990 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64fbb5e8-4159-4b1d-b9df-79ab2a79fd9f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:00.242426 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64fbb5e8-4159-4b1d-b9df-79ab2a79fd9f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:00.258990 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-64fbb5e8-4159-4b1d-b9df-79ab2a79fd9f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] HTTP exception thrown: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-64fbb5e8-4159-4b1d-b9df-79ab2a79fd9f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Request method failure captured: Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee HTTP/1.1 Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV1FViMK-WvBvO8SLI8drD1UcXlTPANFWG-ZTvaw7ModKJdGRWngdLI5cp6n7bXZ7oPe4LkLOonqm901dlPL1Z_CDQlnflfzMT4YPNiiBNZ_K890mBj2sVo-ptm5duO44Ujpzx_OuaK4ZxTnFio58yttRWo_3AshSXsX0p_7cyovml4 Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:06:00.260529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:06:00.262393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c0d083e8cef4333b9514d2256991647", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:06:00.262393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:00.262393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:06:00.262393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:00.262393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:06:00.262393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:06:00.262393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:06:00.262393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 0bcbf6513b6a4df3b044fadfb7888d54 Oct 14 13:06:00.262393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:06:00.262393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:06:00.262393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. Oct 14 13:06:00.262393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '5fe0d2ae-312a-4c18-96d6-ae8d86372eee'} Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:06:00.267061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. Oct 14 13:06:00.268267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:00.270728 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-64fbb5e8-4159-4b1d-b9df-79ab2a79fd9f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Returning 404 to user: Instance 5fe0d2ae-312a-4c18-96d6-ae8d86372eee could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:06:00.270728 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-64fbb5e8-4159-4b1d-b9df-79ab2a79fd9f tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee" status: 404 len: 111 microversion: 2.1 time: 0.035285 Oct 14 13:06:00.270728 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 374/741] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:00 2022] GET /compute/v2.1/servers/5fe0d2ae-312a-4c18-96d6-ae8d86372eee => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:06:01.420217 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-65ff52c8-e33b-45d4-82ae-0fe72f808dc7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:01.420884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-65ff52c8-e33b-45d4-82ae-0fe72f808dc7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:01.428103 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-65ff52c8-e33b-45d4-82ae-0fe72f808dc7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:01.428733 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-65ff52c8-e33b-45d4-82ae-0fe72f808dc7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:01.429302 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-65ff52c8-e33b-45d4-82ae-0fe72f808dc7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:01.430148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-65ff52c8-e33b-45d4-82ae-0fe72f808dc7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:01.430697 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-65ff52c8-e33b-45d4-82ae-0fe72f808dc7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:01.431239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-65ff52c8-e33b-45d4-82ae-0fe72f808dc7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:01.447103 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-65ff52c8-e33b-45d4-82ae-0fe72f808dc7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] HTTP exception thrown: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-65ff52c8-e33b-45d4-82ae-0fe72f808dc7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Request method failure captured: Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: DELETE /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 HTTP/1.1 Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV1FViMK-WvBvO8SLI8drD1UcXlTPANFWG-ZTvaw7ModKJdGRWngdLI5cp6n7bXZ7oPe4LkLOonqm901dlPL1Z_CDQlnflfzMT4YPNiiBNZ_K890mBj2sVo-ptm5duO44Ujpzx_OuaK4ZxTnFio58yttRWo_3AshSXsX0p_7cyovml4 Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:06:01.449273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:06:01.450980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c0d083e8cef4333b9514d2256991647", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:06:01.450980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:01.450980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:06:01.450980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:01.450980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:06:01.450980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:06:01.450980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:06:01.450980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 0bcbf6513b6a4df3b044fadfb7888d54 Oct 14 13:06:01.450980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:06:01.450980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:06:01.450980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. Oct 14 13:06:01.450980 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': 'defcc0c0-d0f4-4913-899d-4d20b75896d6'} Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:06:01.451965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. Oct 14 13:06:01.453450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:01.454927 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-65ff52c8-e33b-45d4-82ae-0fe72f808dc7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Returning 404 to user: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:06:01.454927 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-65ff52c8-e33b-45d4-82ae-0fe72f808dc7 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "DELETE /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 404 len: 111 microversion: 2.1 time: 0.036222 Oct 14 13:06:01.454927 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 368/742] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:06:01 2022] DELETE /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:06:01.463839 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-50423bd7-996a-449f-8b7e-2ca8c899b5d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:01.464453 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-50423bd7-996a-449f-8b7e-2ca8c899b5d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] [instance: defcc0c0-d0f4-4913-899d-4d20b75896d6] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:01.471217 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-50423bd7-996a-449f-8b7e-2ca8c899b5d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:01.471970 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-50423bd7-996a-449f-8b7e-2ca8c899b5d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:01.472425 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-50423bd7-996a-449f-8b7e-2ca8c899b5d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:01.473373 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-50423bd7-996a-449f-8b7e-2ca8c899b5d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:01.473947 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-50423bd7-996a-449f-8b7e-2ca8c899b5d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:01.474371 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-50423bd7-996a-449f-8b7e-2ca8c899b5d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:01.491180 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-50423bd7-996a-449f-8b7e-2ca8c899b5d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] HTTP exception thrown: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-50423bd7-996a-449f-8b7e-2ca8c899b5d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Request method failure captured: Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 HTTP/1.1 Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV1FViMK-WvBvO8SLI8drD1UcXlTPANFWG-ZTvaw7ModKJdGRWngdLI5cp6n7bXZ7oPe4LkLOonqm901dlPL1Z_CDQlnflfzMT4YPNiiBNZ_K890mBj2sVo-ptm5duO44Ujpzx_OuaK4ZxTnFio58yttRWo_3AshSXsX0p_7cyovml4 Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:06:01.493266 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:06:01.494647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6c0d083e8cef4333b9514d2256991647"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6c0d083e8cef4333b9514d2256991647", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:06:01.494647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:01.494647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 6c0d083e8cef4333b9514d2256991647 Oct 14 13:06:01.494647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-28905593 Oct 14 13:06:01.494647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:06:01.494647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:06:01.494647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:06:01.494647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 0bcbf6513b6a4df3b044fadfb7888d54 Oct 14 13:06:01.494647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-AttachVolumeNegativeTest-28905593-project Oct 14 13:06:01.494647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:06:01.494647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. Oct 14 13:06:01.494647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': 'defcc0c0-d0f4-4913-899d-4d20b75896d6'} Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:06:01.495465 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. Oct 14 13:06:01.496719 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:01.498808 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-50423bd7-996a-449f-8b7e-2ca8c899b5d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] Returning 404 to user: Instance defcc0c0-d0f4-4913-899d-4d20b75896d6 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:06:01.498808 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-50423bd7-996a-449f-8b7e-2ca8c899b5d1 tempest-AttachVolumeNegativeTest-28905593 tempest-AttachVolumeNegativeTest-28905593-project] 10.222.0.47 "GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6" status: 404 len: 111 microversion: 2.1 time: 0.035516 Oct 14 13:06:01.498808 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 375/743] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:01 2022] GET /compute/v2.1/servers/defcc0c0-d0f4-4913-899d-4d20b75896d6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:06:09.657107 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-1b9a6055-3d2d-432c-9bd6-e25a2bca9ac7 tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] Action: 'create', calling method: .version_select at 0x7fbb81991f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1172081468", "metadata": {"Type": "work"}}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:06:10.288414 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-1b9a6055-3d2d-432c-9bd6-e25a2bca9ac7 tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.000471 Oct 14 13:06:10.302802 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 369/744] 10.222.0.47 () {60 vars in 1156 bytes} [Fri Oct 14 13:06:09 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1015 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 14 13:06:10.308090 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f3c2c863-0c05-4ece-8b06-506d0fdf5159 tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] Calling method '.version_select at 0x7fbb819a8310>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:10.439622 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f3c2c863-0c05-4ece-8b06-506d0fdf5159 tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/667ade33-5e10-40f2-8667-5f35085d0bf9" status: 200 len: 353 microversion: 2.1 time: 0.136309 Oct 14 13:06:10.440773 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 376/745] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Oct 14 13:06:10 2022] GET /compute/v2.1/os-volumes/667ade33-5e10-40f2-8667-5f35085d0bf9 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:06:11.456533 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:11.457518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=28 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:11.466787 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f2b20fb4-8e1b-4a4b-a264-d091057f91dc tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] Calling method '.version_select at 0x7fbb819a8670>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:11.548221 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-f2b20fb4-8e1b-4a4b-a264-d091057f91dc tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/667ade33-5e10-40f2-8667-5f35085d0bf9" status: 200 len: 354 microversion: 2.1 time: 0.093185 Oct 14 13:06:11.548790 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 370/746] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Oct 14 13:06:11 2022] GET /compute/v2.1/os-volumes/667ade33-5e10-40f2-8667-5f35085d0bf9 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:06:11.559836 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=37 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:11.560628 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=25 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:11.565587 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-38d7b3a3-4758-4b51-ad41-29c9bdc2c7f9 tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] Calling method '.version_select at 0x7fbb819f74c0>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:11.645516 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-38d7b3a3-4758-4b51-ad41-29c9bdc2c7f9 tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/667ade33-5e10-40f2-8667-5f35085d0bf9" status: 200 len: 354 microversion: 2.1 time: 0.086867 Oct 14 13:06:11.658745 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 377/747] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Oct 14 13:06:11 2022] GET /compute/v2.1/os-volumes/667ade33-5e10-40f2-8667-5f35085d0bf9 => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:06:11.669377 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4ebb7811-ff20-4f84-871e-1cfafcb1d592 tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] Calling method '.version_select at 0x7fbb81d7a160>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:11.761873 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4ebb7811-ff20-4f84-871e-1cfafcb1d592 tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/667ade33-5e10-40f2-8667-5f35085d0bf9" status: 202 len: 0 microversion: 2.1 time: 0.100249 Oct 14 13:06:11.762507 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 371/748] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Oct 14 13:06:11 2022] DELETE /compute/v2.1/os-volumes/667ade33-5e10-40f2-8667-5f35085d0bf9 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:06:11.772326 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2f5e2446-02f0-4ba1-a0d4-86f8372f8cd0 tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] Calling method '.version_select at 0x7fbb8199d8b0>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:11.834627 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2f5e2446-02f0-4ba1-a0d4-86f8372f8cd0 tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/667ade33-5e10-40f2-8667-5f35085d0bf9" status: 200 len: 353 microversion: 2.1 time: 0.067753 Oct 14 13:06:11.835344 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 378/749] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Oct 14 13:06:11 2022] GET /compute/v2.1/os-volumes/667ade33-5e10-40f2-8667-5f35085d0bf9 => generated 353 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:06:12.849066 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2dd4af28-ef2b-4e89-be44-679c7bca5789 tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] Calling method '.version_select at 0x7fbb81a16040>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:12.881152 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-2dd4af28-ef2b-4e89-be44-679c7bca5789 tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] HTTP exception thrown: Volume 667ade33-5e10-40f2-8667-5f35085d0bf9 could not be found. Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2dd4af28-ef2b-4e89-be44-679c7bca5789 tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] Request method failure captured: Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: GET /compute/v2.1/os-volumes/667ade33-5e10-40f2-8667-5f35085d0bf9 HTTP/1.1 Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV7Bp7YpyRfjuDmJX2GxW3-d8wgmRTlSQOlOSkdLPsdO8Ttwv1sVt43ZEsfqlNazXfZuC2v6iAzT1p9YGXkGhEL9SFR13rv_uxet0y6atq19K15KM_DDTQkDCEbyPvb9HF2RS0lO04xSbPKOotXFs6TtEhbI-ZfW9px-Bhvsw7CujYo Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: bf95eb72df7c44c6be34a99178afa63e Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-VolumesGetTestJSON-1317858358 Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:06:12.884209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:06:12.885611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bf95eb72df7c44c6be34a99178afa63e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bf95eb72df7c44c6be34a99178afa63e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bf95eb72df7c44c6be34a99178afa63e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bf95eb72df7c44c6be34a99178afa63e", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:06:12.885611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-VolumesGetTestJSON-1317858358 Oct 14 13:06:12.885611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: bf95eb72df7c44c6be34a99178afa63e Oct 14 13:06:12.885611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-VolumesGetTestJSON-1317858358 Oct 14 13:06:12.885611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-VolumesGetTestJSON-1317858358-project Oct 14 13:06:12.885611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:06:12.885611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:06:12.885611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 80052133df7f4d34a70d5626bf767727 Oct 14 13:06:12.885611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-VolumesGetTestJSON-1317858358-project Oct 14 13:06:12.885611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: Oct 14 13:06:12.885611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Volume 667ade33-5e10-40f2-8667-5f35085d0bf9 could not be found. Oct 14 13:06:12.885611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '667ade33-5e10-40f2-8667-5f35085d0bf9'} Oct 14 13:06:12.885611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 667ade33-5e10-40f2-8667-5f35085d0bf9 could not be found. (HTTP 404) (Request-ID: req-4a8f11f2-bbc5-4e9f-a4ba-9181259e85c3) Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:12.886466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 14 13:06:12.888292 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 667ade33-5e10-40f2-8667-5f35085d0bf9 could not be found. Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 14 13:06:12.889469 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:06:12.893756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 667ade33-5e10-40f2-8667-5f35085d0bf9 could not be found. Oct 14 13:06:12.893756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:12.893756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:12.893756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:12.893756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:12.893756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:12.893756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:12.893756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:06:12.893756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:06:12.893756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 667ade33-5e10-40f2-8667-5f35085d0bf9 could not be found. Oct 14 13:06:12.893756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:12.893756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2dd4af28-ef2b-4e89-be44-679c7bca5789 tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] Returning 404 to user: Volume 667ade33-5e10-40f2-8667-5f35085d0bf9 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:06:12.893756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-2dd4af28-ef2b-4e89-be44-679c7bca5789 tempest-VolumesGetTestJSON-1317858358 tempest-VolumesGetTestJSON-1317858358-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/667ade33-5e10-40f2-8667-5f35085d0bf9" status: 404 len: 109 microversion: 2.1 time: 0.041429 Oct 14 13:06:12.893756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 372/750] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Oct 14 13:06:12 2022] GET /compute/v2.1/os-volumes/667ade33-5e10-40f2-8667-5f35085d0bf9 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:06:18.652695 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e3fe5603-9289-4580-b8f7-dc34bce23a77 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Action: 'create', calling method: .version_select at 0x7fbb81ac2790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1954120748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9l4QtVfLj9JAqNPy7NSxuLYhTcBAjzlMhOuXubaKbop4nYQaMXZdKRmVB+S9TDecCpYOZZ+MaEJo3hD5WY1yW31kz0RNFTM1JoKGt0lT01ql8swgGje/pcgALmm62dcg=="}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:06:18.670472 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-e3fe5603-9289-4580-b8f7-dc34bce23a77 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Getting quotas for project d79493455fcd4feabbbecbe929e0f5fc. Resources: {'key_pairs'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:06:18.674440 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-e3fe5603-9289-4580-b8f7-dc34bce23a77 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Getting quotas for user 75c10f4846c2498e8cc93a3c3c5ecdd9 and project d79493455fcd4feabbbecbe929e0f5fc. Resources: {'key_pairs'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:06:18.697621 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e3fe5603-9289-4580-b8f7-dc34bce23a77 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049261 Oct 14 13:06:18.698142 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 379/751] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Oct 14 13:06:18 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:06:18.798549 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-617775609", "imageRef": "6377d5dc-b5aa-45a7-8f87-6e1501fd4cf9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1954120748", "networks": [{"uuid": "c33965bf-76ca-409a-bb7b-ab4212679475"}]}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:06:18.853386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.network.neutron [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] validate_networks() for [('c33965bf-76ca-409a-bb7b-ab4212679475', None, None, None, None, None)] {{(pid=118869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:06:19.514027 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Flavor limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:06:19.514451 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Image limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:06:19.514922 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Flavor pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:06:19.515330 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Image pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:06:19.515739 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:06:19.528103 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:19.528585 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:19.529025 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:19.529784 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:19.530241 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:19.530669 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:19.554209 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Getting quotas for project d79493455fcd4feabbbecbe929e0f5fc. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:06:19.561050 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Getting quotas for user 75c10f4846c2498e8cc93a3c3c5ecdd9 and project d79493455fcd4feabbbecbe929e0f5fc. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:06:19.573562 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Going to run 1 instances... {{(pid=118869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:06:19.575958 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6377d5dc-b5aa-45a7-8f87-6e1501fd4cf9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:06:19.624479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4bc228c8-d7ab-4d8a-b3fa-ed113ce2713d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830050 Oct 14 13:06:19.625334 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 373/752] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:06:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 13:06:19.637427 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9da29417-49a6-4922-91e4-10588acae7c7 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:19.638157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-9da29417-49a6-4922-91e4-10588acae7c7 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:19.696539 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9da29417-49a6-4922-91e4-10588acae7c7 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:19.704192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-9da29417-49a6-4922-91e4-10588acae7c7 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1258 microversion: 2.1 time: 0.070912 Oct 14 13:06:19.704756 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 380/753] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:19 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:20.728140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cf0d03de-118f-44d2-83a1-6bd0587a6f80 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:20.728771 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-cf0d03de-118f-44d2-83a1-6bd0587a6f80 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:20.736754 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf0d03de-118f-44d2-83a1-6bd0587a6f80 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:20.737438 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf0d03de-118f-44d2-83a1-6bd0587a6f80 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:20.738021 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf0d03de-118f-44d2-83a1-6bd0587a6f80 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:20.739049 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf0d03de-118f-44d2-83a1-6bd0587a6f80 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:20.739550 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf0d03de-118f-44d2-83a1-6bd0587a6f80 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:20.740087 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf0d03de-118f-44d2-83a1-6bd0587a6f80 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:20.804512 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-cf0d03de-118f-44d2-83a1-6bd0587a6f80 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:20.812084 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-cf0d03de-118f-44d2-83a1-6bd0587a6f80 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1262 microversion: 2.1 time: 0.088981 Oct 14 13:06:20.812635 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 374/754] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:20 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:21.834391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-52b32edb-3f1a-4975-b51c-21a92b34aa86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:21.835029 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-52b32edb-3f1a-4975-b51c-21a92b34aa86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:21.841506 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-52b32edb-3f1a-4975-b51c-21a92b34aa86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:21.842003 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-52b32edb-3f1a-4975-b51c-21a92b34aa86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:21.842455 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-52b32edb-3f1a-4975-b51c-21a92b34aa86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:21.843104 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-52b32edb-3f1a-4975-b51c-21a92b34aa86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:21.843552 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-52b32edb-3f1a-4975-b51c-21a92b34aa86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:21.843970 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-52b32edb-3f1a-4975-b51c-21a92b34aa86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:21.903586 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-52b32edb-3f1a-4975-b51c-21a92b34aa86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:21.911146 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-52b32edb-3f1a-4975-b51c-21a92b34aa86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1262 microversion: 2.1 time: 0.080547 Oct 14 13:06:21.911668 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 381/755] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:21 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:22.933162 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-9b876925-fbae-45de-b65d-cc0c04de2b56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:22.933857 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-9b876925-fbae-45de-b65d-cc0c04de2b56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:22.940588 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9b876925-fbae-45de-b65d-cc0c04de2b56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:22.941070 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9b876925-fbae-45de-b65d-cc0c04de2b56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:22.941610 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9b876925-fbae-45de-b65d-cc0c04de2b56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:22.942304 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9b876925-fbae-45de-b65d-cc0c04de2b56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:22.942755 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9b876925-fbae-45de-b65d-cc0c04de2b56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:22.943189 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9b876925-fbae-45de-b65d-cc0c04de2b56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:23.004573 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-9b876925-fbae-45de-b65d-cc0c04de2b56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:23.012808 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-9b876925-fbae-45de-b65d-cc0c04de2b56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1316 microversion: 2.1 time: 0.083652 Oct 14 13:06:23.013373 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 375/756] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:22 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1316 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:24.036274 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d8b36b90-0037-4dbb-8874-19f80d02b4b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:24.036880 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-d8b36b90-0037-4dbb-8874-19f80d02b4b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:24.043915 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d8b36b90-0037-4dbb-8874-19f80d02b4b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:24.044392 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d8b36b90-0037-4dbb-8874-19f80d02b4b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:24.044820 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d8b36b90-0037-4dbb-8874-19f80d02b4b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:24.045546 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d8b36b90-0037-4dbb-8874-19f80d02b4b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:24.046025 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d8b36b90-0037-4dbb-8874-19f80d02b4b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:24.046441 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d8b36b90-0037-4dbb-8874-19f80d02b4b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:24.329100 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-d8b36b90-0037-4dbb-8874-19f80d02b4b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:24.337316 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-d8b36b90-0037-4dbb-8874-19f80d02b4b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1316 microversion: 2.1 time: 0.304856 Oct 14 13:06:24.337920 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 382/757] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:24 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:25.360459 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ca395837-5bca-4446-adc0-42aac35b7899 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:25.361067 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ca395837-5bca-4446-adc0-42aac35b7899 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:25.368117 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ca395837-5bca-4446-adc0-42aac35b7899 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:25.368598 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ca395837-5bca-4446-adc0-42aac35b7899 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:25.369027 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ca395837-5bca-4446-adc0-42aac35b7899 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:25.369738 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ca395837-5bca-4446-adc0-42aac35b7899 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:25.370194 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ca395837-5bca-4446-adc0-42aac35b7899 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:25.370616 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ca395837-5bca-4446-adc0-42aac35b7899 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:25.430273 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ca395837-5bca-4446-adc0-42aac35b7899 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:25.437810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ca395837-5bca-4446-adc0-42aac35b7899 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1316 microversion: 2.1 time: 0.081436 Oct 14 13:06:25.438362 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 376/758] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:25 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1316 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:26.460363 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1d9cb3a8-0bbe-4fa5-9407-141bd8bdef25 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:26.460917 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1d9cb3a8-0bbe-4fa5-9407-141bd8bdef25 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:26.467037 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d9cb3a8-0bbe-4fa5-9407-141bd8bdef25 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:26.467521 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d9cb3a8-0bbe-4fa5-9407-141bd8bdef25 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:26.467957 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d9cb3a8-0bbe-4fa5-9407-141bd8bdef25 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:26.468642 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d9cb3a8-0bbe-4fa5-9407-141bd8bdef25 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:26.469094 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d9cb3a8-0bbe-4fa5-9407-141bd8bdef25 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:26.469540 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1d9cb3a8-0bbe-4fa5-9407-141bd8bdef25 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:26.596030 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-1d9cb3a8-0bbe-4fa5-9407-141bd8bdef25 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:26.604198 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1d9cb3a8-0bbe-4fa5-9407-141bd8bdef25 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.148034 Oct 14 13:06:26.604772 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 383/759] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:26 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:27.627131 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-b1bae4a4-3a1a-4404-81f4-ccf62490facc tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:27.627814 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-b1bae4a4-3a1a-4404-81f4-ccf62490facc tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:27.635021 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b1bae4a4-3a1a-4404-81f4-ccf62490facc tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:27.635501 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b1bae4a4-3a1a-4404-81f4-ccf62490facc tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:27.635983 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b1bae4a4-3a1a-4404-81f4-ccf62490facc tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:27.636679 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b1bae4a4-3a1a-4404-81f4-ccf62490facc tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:27.637128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b1bae4a4-3a1a-4404-81f4-ccf62490facc tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:27.637570 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b1bae4a4-3a1a-4404-81f4-ccf62490facc tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:27.790856 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-b1bae4a4-3a1a-4404-81f4-ccf62490facc tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:27.799058 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-b1bae4a4-3a1a-4404-81f4-ccf62490facc tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.175690 Oct 14 13:06:27.799904 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 377/760] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:27 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:28.823114 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-71353297-4a81-45c8-bc5f-25c4570bcbf1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:28.823725 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-71353297-4a81-45c8-bc5f-25c4570bcbf1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:28.830186 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-71353297-4a81-45c8-bc5f-25c4570bcbf1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:28.830674 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-71353297-4a81-45c8-bc5f-25c4570bcbf1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:28.831113 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-71353297-4a81-45c8-bc5f-25c4570bcbf1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:28.831798 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-71353297-4a81-45c8-bc5f-25c4570bcbf1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:28.832252 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-71353297-4a81-45c8-bc5f-25c4570bcbf1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:28.832674 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-71353297-4a81-45c8-bc5f-25c4570bcbf1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:28.962896 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-71353297-4a81-45c8-bc5f-25c4570bcbf1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:28.971626 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-71353297-4a81-45c8-bc5f-25c4570bcbf1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.152884 Oct 14 13:06:28.972316 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 384/761] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:28 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:29.121504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e3f30248-52cb-4cd2-a658-5fc656de0354 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:29.124569 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e3f30248-52cb-4cd2-a658-5fc656de0354 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:29.132219 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e3f30248-52cb-4cd2-a658-5fc656de0354 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:29.132700 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e3f30248-52cb-4cd2-a658-5fc656de0354 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:29.133124 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e3f30248-52cb-4cd2-a658-5fc656de0354 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:29.134588 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e3f30248-52cb-4cd2-a658-5fc656de0354 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:29.135237 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e3f30248-52cb-4cd2-a658-5fc656de0354 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:29.135871 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e3f30248-52cb-4cd2-a658-5fc656de0354 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:29.173318 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e3f30248-52cb-4cd2-a658-5fc656de0354 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056183 Oct 14 13:06:29.173893 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 378/762] 10.222.0.47 () {60 vars in 1343 bytes} [Fri Oct 14 13:06:29 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:29.245294 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2caae1ee-d0b2-482e-9626-b4aea77a142a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:29.245909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2caae1ee-d0b2-482e-9626-b4aea77a142a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:29.252077 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2caae1ee-d0b2-482e-9626-b4aea77a142a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:29.252832 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2caae1ee-d0b2-482e-9626-b4aea77a142a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:29.253335 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2caae1ee-d0b2-482e-9626-b4aea77a142a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:29.254212 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2caae1ee-d0b2-482e-9626-b4aea77a142a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:29.254910 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2caae1ee-d0b2-482e-9626-b4aea77a142a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:29.255425 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2caae1ee-d0b2-482e-9626-b4aea77a142a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:29.283367 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2caae1ee-d0b2-482e-9626-b4aea77a142a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Going to try to terminate instance {{(pid=118868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:06:29.378107 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2caae1ee-d0b2-482e-9626-b4aea77a142a tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 204 len: 0 microversion: 2.20 time: 0.137330 Oct 14 13:06:29.379023 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 385/763] 10.222.0.47 () {60 vars in 1280 bytes} [Fri Oct 14 13:06:29 2022] DELETE /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 14 13:06:29.387559 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-72c42eb9-acf1-4635-8811-e0db81071144 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:29.388168 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-72c42eb9-acf1-4635-8811-e0db81071144 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:29.394710 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-72c42eb9-acf1-4635-8811-e0db81071144 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:29.395223 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-72c42eb9-acf1-4635-8811-e0db81071144 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:29.395658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-72c42eb9-acf1-4635-8811-e0db81071144 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:29.396353 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-72c42eb9-acf1-4635-8811-e0db81071144 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:29.397378 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-72c42eb9-acf1-4635-8811-e0db81071144 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:29.397828 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-72c42eb9-acf1-4635-8811-e0db81071144 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:29.540965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:29.548184 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-72c42eb9-acf1-4635-8811-e0db81071144 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:29.557985 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-72c42eb9-acf1-4635-8811-e0db81071144 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:29.559018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-72c42eb9-acf1-4635-8811-e0db81071144 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:29.560302 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-72c42eb9-acf1-4635-8811-e0db81071144 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.176986 Oct 14 13:06:29.560848 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 379/764] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:06:29 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:06:29.996641 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-06b7d2c7-a22d-459d-b384-510186244a62 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:29.997350 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-06b7d2c7-a22d-459d-b384-510186244a62 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:30.009819 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=6 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:30.027068 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-06b7d2c7-a22d-459d-b384-510186244a62 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:30.027700 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-06b7d2c7-a22d-459d-b384-510186244a62 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:30.028209 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-06b7d2c7-a22d-459d-b384-510186244a62 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:30.028941 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-06b7d2c7-a22d-459d-b384-510186244a62 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:30.029396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-06b7d2c7-a22d-459d-b384-510186244a62 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:30.029847 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-06b7d2c7-a22d-459d-b384-510186244a62 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:30.210422 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-06b7d2c7-a22d-459d-b384-510186244a62 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:30.220414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-06b7d2c7-a22d-459d-b384-510186244a62 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.227942 Oct 14 13:06:30.225612 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 386/765] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:29 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:30.586641 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-05a647ed-4b34-459f-b8df-359648bdcdaa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:30.588030 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-05a647ed-4b34-459f-b8df-359648bdcdaa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:30.600579 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=6 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:30.603034 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-05a647ed-4b34-459f-b8df-359648bdcdaa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:30.603507 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-05a647ed-4b34-459f-b8df-359648bdcdaa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:30.604028 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-05a647ed-4b34-459f-b8df-359648bdcdaa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:30.604825 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-05a647ed-4b34-459f-b8df-359648bdcdaa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:30.605265 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-05a647ed-4b34-459f-b8df-359648bdcdaa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:30.605719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-05a647ed-4b34-459f-b8df-359648bdcdaa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:30.856425 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-05a647ed-4b34-459f-b8df-359648bdcdaa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:30.867212 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-05a647ed-4b34-459f-b8df-359648bdcdaa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:30.868874 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-05a647ed-4b34-459f-b8df-359648bdcdaa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:30.870194 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-05a647ed-4b34-459f-b8df-359648bdcdaa tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.288339 Oct 14 13:06:30.876781 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 380/766] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:06:30 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:06:31.244361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4535a246-a068-40bd-97eb-3074d5f7d8f9 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:31.244902 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-4535a246-a068-40bd-97eb-3074d5f7d8f9 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:31.252194 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4535a246-a068-40bd-97eb-3074d5f7d8f9 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:31.252844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4535a246-a068-40bd-97eb-3074d5f7d8f9 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:31.253474 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4535a246-a068-40bd-97eb-3074d5f7d8f9 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:31.254200 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4535a246-a068-40bd-97eb-3074d5f7d8f9 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:31.254654 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4535a246-a068-40bd-97eb-3074d5f7d8f9 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:31.255076 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4535a246-a068-40bd-97eb-3074d5f7d8f9 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:31.389800 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-4535a246-a068-40bd-97eb-3074d5f7d8f9 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:31.398861 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4535a246-a068-40bd-97eb-3074d5f7d8f9 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.158394 Oct 14 13:06:31.399996 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 387/767] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:31 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:31.896298 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f96065ac-7ea1-4c30-962d-9b6cc7ecfc8f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:31.896920 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f96065ac-7ea1-4c30-962d-9b6cc7ecfc8f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:31.914906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f96065ac-7ea1-4c30-962d-9b6cc7ecfc8f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:31.916194 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f96065ac-7ea1-4c30-962d-9b6cc7ecfc8f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:31.917236 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f96065ac-7ea1-4c30-962d-9b6cc7ecfc8f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:31.918418 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f96065ac-7ea1-4c30-962d-9b6cc7ecfc8f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:31.919047 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f96065ac-7ea1-4c30-962d-9b6cc7ecfc8f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:31.919652 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f96065ac-7ea1-4c30-962d-9b6cc7ecfc8f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:32.075173 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f96065ac-7ea1-4c30-962d-9b6cc7ecfc8f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:32.083506 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f96065ac-7ea1-4c30-962d-9b6cc7ecfc8f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:32.085565 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f96065ac-7ea1-4c30-962d-9b6cc7ecfc8f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:32.086751 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-f96065ac-7ea1-4c30-962d-9b6cc7ecfc8f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.194486 Oct 14 13:06:32.087429 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 381/768] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:06:31 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 14 13:06:32.422584 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-019b439e-2380-4b5c-a66f-78bfe5caeb89 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:32.423318 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-019b439e-2380-4b5c-a66f-78bfe5caeb89 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:32.431129 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-019b439e-2380-4b5c-a66f-78bfe5caeb89 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:32.431620 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-019b439e-2380-4b5c-a66f-78bfe5caeb89 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:32.432056 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-019b439e-2380-4b5c-a66f-78bfe5caeb89 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:32.432790 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-019b439e-2380-4b5c-a66f-78bfe5caeb89 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:32.433244 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-019b439e-2380-4b5c-a66f-78bfe5caeb89 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:32.433774 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-019b439e-2380-4b5c-a66f-78bfe5caeb89 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:32.575954 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-019b439e-2380-4b5c-a66f-78bfe5caeb89 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:32.583647 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-019b439e-2380-4b5c-a66f-78bfe5caeb89 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.165062 Oct 14 13:06:32.584250 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 388/769] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:32 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:33.114924 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7082046f-f319-4b65-afb5-1e3558776a2f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:33.115527 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7082046f-f319-4b65-afb5-1e3558776a2f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:33.122268 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7082046f-f319-4b65-afb5-1e3558776a2f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:33.122753 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7082046f-f319-4b65-afb5-1e3558776a2f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:33.123185 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7082046f-f319-4b65-afb5-1e3558776a2f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:33.123881 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7082046f-f319-4b65-afb5-1e3558776a2f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:33.124329 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7082046f-f319-4b65-afb5-1e3558776a2f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:33.124749 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7082046f-f319-4b65-afb5-1e3558776a2f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:33.267382 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7082046f-f319-4b65-afb5-1e3558776a2f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:33.276189 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7082046f-f319-4b65-afb5-1e3558776a2f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:33.277690 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7082046f-f319-4b65-afb5-1e3558776a2f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:33.278861 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7082046f-f319-4b65-afb5-1e3558776a2f tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.167843 Oct 14 13:06:33.279732 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 382/770] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:06:33 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:06:33.606208 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ca58032b-e5ec-4fa1-976e-3f3177b74d41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:33.606971 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-ca58032b-e5ec-4fa1-976e-3f3177b74d41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:33.615348 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ca58032b-e5ec-4fa1-976e-3f3177b74d41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:33.616183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ca58032b-e5ec-4fa1-976e-3f3177b74d41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:33.617051 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ca58032b-e5ec-4fa1-976e-3f3177b74d41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:33.618084 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ca58032b-e5ec-4fa1-976e-3f3177b74d41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:33.619187 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ca58032b-e5ec-4fa1-976e-3f3177b74d41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:33.621051 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ca58032b-e5ec-4fa1-976e-3f3177b74d41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:33.764940 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ca58032b-e5ec-4fa1-976e-3f3177b74d41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:33.773235 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ca58032b-e5ec-4fa1-976e-3f3177b74d41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.171059 Oct 14 13:06:33.773979 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 389/771] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:33 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:34.306575 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7645bc73-5efc-4461-88aa-b4f1d6340c9b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:34.307213 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7645bc73-5efc-4461-88aa-b4f1d6340c9b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:34.313705 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7645bc73-5efc-4461-88aa-b4f1d6340c9b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:34.314181 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7645bc73-5efc-4461-88aa-b4f1d6340c9b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:34.314608 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7645bc73-5efc-4461-88aa-b4f1d6340c9b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:34.315285 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7645bc73-5efc-4461-88aa-b4f1d6340c9b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:34.315750 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7645bc73-5efc-4461-88aa-b4f1d6340c9b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:34.316144 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7645bc73-5efc-4461-88aa-b4f1d6340c9b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:34.457791 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7645bc73-5efc-4461-88aa-b4f1d6340c9b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:34.477449 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7645bc73-5efc-4461-88aa-b4f1d6340c9b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:34.478931 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7645bc73-5efc-4461-88aa-b4f1d6340c9b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:34.480110 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7645bc73-5efc-4461-88aa-b4f1d6340c9b tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.177482 Oct 14 13:06:34.480670 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 383/772] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:06:34 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:06:34.806788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-83020d9a-053e-414c-8266-eebe2151b15b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:34.806788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-83020d9a-053e-414c-8266-eebe2151b15b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:34.807857 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-83020d9a-053e-414c-8266-eebe2151b15b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:34.808216 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-83020d9a-053e-414c-8266-eebe2151b15b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:34.808863 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-83020d9a-053e-414c-8266-eebe2151b15b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:34.809638 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-83020d9a-053e-414c-8266-eebe2151b15b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:34.810126 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-83020d9a-053e-414c-8266-eebe2151b15b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:34.810552 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-83020d9a-053e-414c-8266-eebe2151b15b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:34.964718 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-83020d9a-053e-414c-8266-eebe2151b15b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:34.973462 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-83020d9a-053e-414c-8266-eebe2151b15b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.178400 Oct 14 13:06:34.974055 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 390/773] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:34 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:35.506256 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2deca25a-4d2f-4d5f-ac0e-1f57e1cdfdf2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:35.506890 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-2deca25a-4d2f-4d5f-ac0e-1f57e1cdfdf2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:35.513262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2deca25a-4d2f-4d5f-ac0e-1f57e1cdfdf2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:35.513770 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2deca25a-4d2f-4d5f-ac0e-1f57e1cdfdf2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:35.514200 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2deca25a-4d2f-4d5f-ac0e-1f57e1cdfdf2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:35.514874 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2deca25a-4d2f-4d5f-ac0e-1f57e1cdfdf2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:35.515316 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2deca25a-4d2f-4d5f-ac0e-1f57e1cdfdf2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:35.515732 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2deca25a-4d2f-4d5f-ac0e-1f57e1cdfdf2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:35.643220 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-2deca25a-4d2f-4d5f-ac0e-1f57e1cdfdf2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:35.651746 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-2deca25a-4d2f-4d5f-ac0e-1f57e1cdfdf2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:35.653170 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-2deca25a-4d2f-4d5f-ac0e-1f57e1cdfdf2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:35.654335 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-2deca25a-4d2f-4d5f-ac0e-1f57e1cdfdf2 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.152008 Oct 14 13:06:35.654883 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 384/774] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:06:35 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:06:35.996300 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-feb646d1-c47a-4c12-8f72-82677ee7faa8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:35.996906 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-feb646d1-c47a-4c12-8f72-82677ee7faa8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:36.003216 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-feb646d1-c47a-4c12-8f72-82677ee7faa8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:36.003700 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-feb646d1-c47a-4c12-8f72-82677ee7faa8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:36.004135 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-feb646d1-c47a-4c12-8f72-82677ee7faa8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:36.004964 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-feb646d1-c47a-4c12-8f72-82677ee7faa8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:36.005420 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-feb646d1-c47a-4c12-8f72-82677ee7faa8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:36.005863 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-feb646d1-c47a-4c12-8f72-82677ee7faa8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:36.135067 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-feb646d1-c47a-4c12-8f72-82677ee7faa8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:36.142824 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-feb646d1-c47a-4c12-8f72-82677ee7faa8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.150260 Oct 14 13:06:36.143412 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 391/775] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:35 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:36.679445 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-12ff250f-f264-4f65-8084-297448448448 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:36.680054 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-12ff250f-f264-4f65-8084-297448448448 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:36.686525 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12ff250f-f264-4f65-8084-297448448448 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:36.687009 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12ff250f-f264-4f65-8084-297448448448 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:36.687443 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12ff250f-f264-4f65-8084-297448448448 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:36.688135 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12ff250f-f264-4f65-8084-297448448448 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:36.688593 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12ff250f-f264-4f65-8084-297448448448 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:36.689010 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-12ff250f-f264-4f65-8084-297448448448 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:36.814444 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-12ff250f-f264-4f65-8084-297448448448 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:36.823275 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-12ff250f-f264-4f65-8084-297448448448 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:36.824724 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-12ff250f-f264-4f65-8084-297448448448 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:36.825910 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-12ff250f-f264-4f65-8084-297448448448 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.150440 Oct 14 13:06:36.826497 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 385/776] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:06:36 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:06:37.165828 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9c94d566-d337-4de0-b33f-68947379d8b8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:37.166435 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-9c94d566-d337-4de0-b33f-68947379d8b8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:37.172732 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9c94d566-d337-4de0-b33f-68947379d8b8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:37.173217 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9c94d566-d337-4de0-b33f-68947379d8b8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:37.173712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9c94d566-d337-4de0-b33f-68947379d8b8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:37.174422 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9c94d566-d337-4de0-b33f-68947379d8b8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:37.174868 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9c94d566-d337-4de0-b33f-68947379d8b8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:37.175283 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9c94d566-d337-4de0-b33f-68947379d8b8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:37.341601 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9c94d566-d337-4de0-b33f-68947379d8b8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:37.349986 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-9c94d566-d337-4de0-b33f-68947379d8b8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.187875 Oct 14 13:06:37.350563 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 392/777] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:37 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:37.851506 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0c53a6d5-9af9-456b-9abc-cacf305b0629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:37.852113 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-0c53a6d5-9af9-456b-9abc-cacf305b0629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:37.858663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0c53a6d5-9af9-456b-9abc-cacf305b0629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:37.859151 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0c53a6d5-9af9-456b-9abc-cacf305b0629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:37.859584 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0c53a6d5-9af9-456b-9abc-cacf305b0629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:37.860533 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0c53a6d5-9af9-456b-9abc-cacf305b0629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:37.860983 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0c53a6d5-9af9-456b-9abc-cacf305b0629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:37.861405 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0c53a6d5-9af9-456b-9abc-cacf305b0629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:37.948641 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-fb7e17a8-713c-4485-b5ed-58378c9a0494 req-99e60691-c6ea-4abf-8f94-62cb2bf5814c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62efbcc1-3060-4f79-9a6e-725a62576d91", "tag": "4bcf9a4a-8080-4b16-96b8-764c513ef541"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:06:37.958843 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-fb7e17a8-713c-4485-b5ed-58378c9a0494 req-99e60691-c6ea-4abf-8f94-62cb2bf5814c service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:37.959387 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-fb7e17a8-713c-4485-b5ed-58378c9a0494 req-99e60691-c6ea-4abf-8f94-62cb2bf5814c service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:37.959820 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-fb7e17a8-713c-4485-b5ed-58378c9a0494 req-99e60691-c6ea-4abf-8f94-62cb2bf5814c service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:37.971521 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-fb7e17a8-713c-4485-b5ed-58378c9a0494 req-99e60691-c6ea-4abf-8f94-62cb2bf5814c service nova] Creating event network-changed:4bcf9a4a-8080-4b16-96b8-764c513ef541 for instance 62efbcc1-3060-4f79-9a6e-725a62576d91 on hv-cinder-82099 Oct 14 13:06:37.977375 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-fb7e17a8-713c-4485-b5ed-58378c9a0494 req-99e60691-c6ea-4abf-8f94-62cb2bf5814c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032750 Oct 14 13:06:37.978440 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 393/778] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:06:38.005432 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-0c53a6d5-9af9-456b-9abc-cacf305b0629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:38.013463 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-0c53a6d5-9af9-456b-9abc-cacf305b0629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:38.015007 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-0c53a6d5-9af9-456b-9abc-cacf305b0629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:38.016153 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-0c53a6d5-9af9-456b-9abc-cacf305b0629 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.169121 Oct 14 13:06:38.016706 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 386/779] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:06:37 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:06:38.375674 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-06156305-e53d-4621-82d0-f0ad5e6db5ac tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:38.376915 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-06156305-e53d-4621-82d0-f0ad5e6db5ac tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:38.392102 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-06156305-e53d-4621-82d0-f0ad5e6db5ac tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:38.392814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-06156305-e53d-4621-82d0-f0ad5e6db5ac tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:38.393412 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-06156305-e53d-4621-82d0-f0ad5e6db5ac tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:38.394391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-06156305-e53d-4621-82d0-f0ad5e6db5ac tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:38.395071 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-06156305-e53d-4621-82d0-f0ad5e6db5ac tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:38.396144 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-06156305-e53d-4621-82d0-f0ad5e6db5ac tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:38.589673 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-06156305-e53d-4621-82d0-f0ad5e6db5ac tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:38.597365 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-06156305-e53d-4621-82d0-f0ad5e6db5ac tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.227394 Oct 14 13:06:38.597955 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 394/780] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:38 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:39.040751 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f969c984-8ad1-4586-887a-29df13853c99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:39.041386 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f969c984-8ad1-4586-887a-29df13853c99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:39.049187 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f969c984-8ad1-4586-887a-29df13853c99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:39.049790 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f969c984-8ad1-4586-887a-29df13853c99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:39.050233 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f969c984-8ad1-4586-887a-29df13853c99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:39.050966 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f969c984-8ad1-4586-887a-29df13853c99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:39.051421 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f969c984-8ad1-4586-887a-29df13853c99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:39.051875 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f969c984-8ad1-4586-887a-29df13853c99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:39.182039 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f969c984-8ad1-4586-887a-29df13853c99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:39.190310 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f969c984-8ad1-4586-887a-29df13853c99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:39.191764 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f969c984-8ad1-4586-887a-29df13853c99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:39.192923 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-f969c984-8ad1-4586-887a-29df13853c99 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1725 microversion: 2.20 time: 0.156585 Oct 14 13:06:39.193711 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 387/781] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:06:39 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:06:39.620313 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-88cd63c4-1bad-4974-8d0b-d63af95572ee tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:39.620858 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-88cd63c4-1bad-4974-8d0b-d63af95572ee tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:39.627799 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-88cd63c4-1bad-4974-8d0b-d63af95572ee tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:39.628290 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-88cd63c4-1bad-4974-8d0b-d63af95572ee tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:39.628724 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-88cd63c4-1bad-4974-8d0b-d63af95572ee tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:39.629406 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-88cd63c4-1bad-4974-8d0b-d63af95572ee tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:39.630146 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-88cd63c4-1bad-4974-8d0b-d63af95572ee tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:39.631062 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-88cd63c4-1bad-4974-8d0b-d63af95572ee tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:39.779426 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-88cd63c4-1bad-4974-8d0b-d63af95572ee tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:39.787942 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-88cd63c4-1bad-4974-8d0b-d63af95572ee tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.171562 Oct 14 13:06:39.789522 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 395/782] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:39 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:40.005421 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-a23a07ba-ff74-4ce1-a730-a02b2ea8dad2 req-9968a1fc-755f-47cd-8b32-89cc8be6bc3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bff20a0-76b8-44e6-9f5c-87a9fce18f87", "name": "network-vif-deleted", "tag": "096cc001-9ca8-472a-8f3d-2a345a805218"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:06:40.015384 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-a23a07ba-ff74-4ce1-a730-a02b2ea8dad2 req-9968a1fc-755f-47cd-8b32-89cc8be6bc3e service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:40.015856 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-a23a07ba-ff74-4ce1-a730-a02b2ea8dad2 req-9968a1fc-755f-47cd-8b32-89cc8be6bc3e service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:40.016277 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-a23a07ba-ff74-4ce1-a730-a02b2ea8dad2 req-9968a1fc-755f-47cd-8b32-89cc8be6bc3e service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:40.027779 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-a23a07ba-ff74-4ce1-a730-a02b2ea8dad2 req-9968a1fc-755f-47cd-8b32-89cc8be6bc3e service nova] Creating event network-vif-deleted:096cc001-9ca8-472a-8f3d-2a345a805218 for instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 on hv-cinder-82099 Oct 14 13:06:40.033235 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-a23a07ba-ff74-4ce1-a730-a02b2ea8dad2 req-9968a1fc-755f-47cd-8b32-89cc8be6bc3e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031643 Oct 14 13:06:40.033880 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 388/783] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:06:40.218737 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5e5afcd1-39cb-4b75-aab6-365da10b0734 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:40.219333 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5e5afcd1-39cb-4b75-aab6-365da10b0734 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:40.225885 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e5afcd1-39cb-4b75-aab6-365da10b0734 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:40.226372 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e5afcd1-39cb-4b75-aab6-365da10b0734 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:40.226814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e5afcd1-39cb-4b75-aab6-365da10b0734 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:40.227501 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e5afcd1-39cb-4b75-aab6-365da10b0734 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:40.227959 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e5afcd1-39cb-4b75-aab6-365da10b0734 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:40.228382 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e5afcd1-39cb-4b75-aab6-365da10b0734 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:40.247453 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:40.294191 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5e5afcd1-39cb-4b75-aab6-365da10b0734 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:40.303923 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5e5afcd1-39cb-4b75-aab6-365da10b0734 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:40.305373 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5e5afcd1-39cb-4b75-aab6-365da10b0734 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:40.306577 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5e5afcd1-39cb-4b75-aab6-365da10b0734 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1658 microversion: 2.20 time: 0.091813 Oct 14 13:06:40.307134 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 396/784] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:06:40 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1658 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:06:40.811781 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-02ad140e-13c0-47f4-a115-81e2d992083d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:40.812425 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-02ad140e-13c0-47f4-a115-81e2d992083d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:40.819754 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-02ad140e-13c0-47f4-a115-81e2d992083d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:40.820229 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-02ad140e-13c0-47f4-a115-81e2d992083d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:40.820653 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-02ad140e-13c0-47f4-a115-81e2d992083d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:40.821329 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-02ad140e-13c0-47f4-a115-81e2d992083d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:40.821800 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-02ad140e-13c0-47f4-a115-81e2d992083d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:40.822216 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-02ad140e-13c0-47f4-a115-81e2d992083d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:40.953575 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-02ad140e-13c0-47f4-a115-81e2d992083d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:40.961772 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-02ad140e-13c0-47f4-a115-81e2d992083d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.154275 Oct 14 13:06:40.962326 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 389/785] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:40 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:41.331796 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-eb52c8d0-ce22-4acb-9d33-64d1f6e55888 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:41.332425 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-eb52c8d0-ce22-4acb-9d33-64d1f6e55888 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:41.338967 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eb52c8d0-ce22-4acb-9d33-64d1f6e55888 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:41.339468 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eb52c8d0-ce22-4acb-9d33-64d1f6e55888 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:41.339908 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eb52c8d0-ce22-4acb-9d33-64d1f6e55888 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:41.340605 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eb52c8d0-ce22-4acb-9d33-64d1f6e55888 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:41.341066 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eb52c8d0-ce22-4acb-9d33-64d1f6e55888 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:41.341507 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-eb52c8d0-ce22-4acb-9d33-64d1f6e55888 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:41.402145 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-eb52c8d0-ce22-4acb-9d33-64d1f6e55888 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:41.410142 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-eb52c8d0-ce22-4acb-9d33-64d1f6e55888 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:41.411597 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-eb52c8d0-ce22-4acb-9d33-64d1f6e55888 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a54235fb424dfd825b2de9f7aaa006', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d716a28995942e788205c1ad1e83bb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:41.412824 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-eb52c8d0-ce22-4acb-9d33-64d1f6e55888 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 200 len: 1658 microversion: 2.20 time: 0.084975 Oct 14 13:06:41.413389 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 397/786] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:06:41 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 1658 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 14 13:06:41.984738 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-35201506-f506-44a3-9f7e-ddc4f3de8fd8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:41.985643 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-35201506-f506-44a3-9f7e-ddc4f3de8fd8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:41.988031 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:41.994152 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-35201506-f506-44a3-9f7e-ddc4f3de8fd8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:41.994663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-35201506-f506-44a3-9f7e-ddc4f3de8fd8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:41.995094 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-35201506-f506-44a3-9f7e-ddc4f3de8fd8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:41.995780 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-35201506-f506-44a3-9f7e-ddc4f3de8fd8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:41.996224 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-35201506-f506-44a3-9f7e-ddc4f3de8fd8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:41.996645 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-35201506-f506-44a3-9f7e-ddc4f3de8fd8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:42.001018 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=95 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:42.124139 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-35201506-f506-44a3-9f7e-ddc4f3de8fd8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:42.131901 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-35201506-f506-44a3-9f7e-ddc4f3de8fd8 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.151461 Oct 14 13:06:42.132322 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 390/787] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:41 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:42.438253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e2af974d-ac81-4e47-812c-74fa74ba182d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:42.438784 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e2af974d-ac81-4e47-812c-74fa74ba182d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:42.441116 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:42.446769 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e2af974d-ac81-4e47-812c-74fa74ba182d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:42.447250 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e2af974d-ac81-4e47-812c-74fa74ba182d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:42.447688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e2af974d-ac81-4e47-812c-74fa74ba182d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:42.448379 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e2af974d-ac81-4e47-812c-74fa74ba182d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:42.448832 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e2af974d-ac81-4e47-812c-74fa74ba182d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:42.449256 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e2af974d-ac81-4e47-812c-74fa74ba182d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:42.464341 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-e2af974d-ac81-4e47-812c-74fa74ba182d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] HTTP exception thrown: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e2af974d-ac81-4e47-812c-74fa74ba182d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Request method failure captured: Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 HTTP/1.1 Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV2GLiiG5lpdVr87nMRGLhHjvG9ei2Ab2yw3BET05lehMn7lWxhZPJhvVW0QyPJg4zwHeSXoKeptZd3lPGMkrdYX7iZyT1b6IQTRIlkqOBTIsV2JzIOoraOorN2U4x-FyJl_VT4YPgsp6hcj_nK7QUE4JvrswjktokYorMze75tXYsA Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 5d716a28995942e788205c1ad1e83bb3 Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:06:42.466006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:06:42.467778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d716a28995942e788205c1ad1e83bb3", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:06:42.467778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:06:42.467778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 5d716a28995942e788205c1ad1e83bb3 Oct 14 13:06:42.467778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:06:42.467778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-AttachVolumeShelveTestJSON-1446019722-project Oct 14 13:06:42.467778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:06:42.467778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:06:42.467778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 26a54235fb424dfd825b2de9f7aaa006 Oct 14 13:06:42.467778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446019722-project Oct 14 13:06:42.467778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:06:42.467778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. Oct 14 13:06:42.467778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '4bff20a0-76b8-44e6-9f5c-87a9fce18f87'} Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:06:42.468688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. Oct 14 13:06:42.470331 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:42.471730 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e2af974d-ac81-4e47-812c-74fa74ba182d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Returning 404 to user: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:06:42.471730 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e2af974d-ac81-4e47-812c-74fa74ba182d tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 404 len: 111 microversion: 2.20 time: 0.033126 Oct 14 13:06:42.471730 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 398/788] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:06:42 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 13:06:42.476317 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-55079ba9-bcc9-42b8-8a1a-8054a1833bb6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '.version_select at 0x7fbb819a8940>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:42.494879 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-55079ba9-bcc9-42b8-8a1a-8054a1833bb6 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209670002" status: 204 len: 0 microversion: 2.20 time: 0.022388 Oct 14 13:06:42.495427 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 391/789] 10.222.0.47 () {60 vars in 1262 bytes} [Fri Oct 14 13:06:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1209670002 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 14 13:06:43.155140 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-55898048-6376-4e99-a80c-cae232579357 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:43.155747 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-55898048-6376-4e99-a80c-cae232579357 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:43.162210 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-55898048-6376-4e99-a80c-cae232579357 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:43.162689 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-55898048-6376-4e99-a80c-cae232579357 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:43.163124 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-55898048-6376-4e99-a80c-cae232579357 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:43.163816 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-55898048-6376-4e99-a80c-cae232579357 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:43.164336 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-55898048-6376-4e99-a80c-cae232579357 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:43.164720 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-55898048-6376-4e99-a80c-cae232579357 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:43.307417 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-55898048-6376-4e99-a80c-cae232579357 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:43.315057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-55898048-6376-4e99-a80c-cae232579357 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.163937 Oct 14 13:06:43.315610 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 399/790] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:43 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:44.338612 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-bf581d34-dce9-41a6-ace1-9d2cd7494c56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:44.339275 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-db8bff57-9c4a-4b7b-8bd2-92b916339055 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:44.339683 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-bf581d34-dce9-41a6-ace1-9d2cd7494c56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:44.339789 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-db8bff57-9c4a-4b7b-8bd2-92b916339055 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:44.345677 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db8bff57-9c4a-4b7b-8bd2-92b916339055 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:44.345819 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bf581d34-dce9-41a6-ace1-9d2cd7494c56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:44.346213 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bf581d34-dce9-41a6-ace1-9d2cd7494c56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:44.346330 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db8bff57-9c4a-4b7b-8bd2-92b916339055 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:44.346641 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bf581d34-dce9-41a6-ace1-9d2cd7494c56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:44.346912 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db8bff57-9c4a-4b7b-8bd2-92b916339055 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:44.347342 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bf581d34-dce9-41a6-ace1-9d2cd7494c56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:44.347699 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db8bff57-9c4a-4b7b-8bd2-92b916339055 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:44.347865 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bf581d34-dce9-41a6-ace1-9d2cd7494c56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:44.348153 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db8bff57-9c4a-4b7b-8bd2-92b916339055 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:44.348293 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bf581d34-dce9-41a6-ace1-9d2cd7494c56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:44.348577 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db8bff57-9c4a-4b7b-8bd2-92b916339055 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:44.362689 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-db8bff57-9c4a-4b7b-8bd2-92b916339055 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] HTTP exception thrown: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-db8bff57-9c4a-4b7b-8bd2-92b916339055 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Request method failure captured: Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: DELETE /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 HTTP/1.1 Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV2GLiiG5lpdVr87nMRGLhHjvG9ei2Ab2yw3BET05lehMn7lWxhZPJhvVW0QyPJg4zwHeSXoKeptZd3lPGMkrdYX7iZyT1b6IQTRIlkqOBTIsV2JzIOoraOorN2U4x-FyJl_VT4YPgsp6hcj_nK7QUE4JvrswjktokYorMze75tXYsA Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 5d716a28995942e788205c1ad1e83bb3 Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:06:44.364363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:06:44.366158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d716a28995942e788205c1ad1e83bb3", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:06:44.366158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:06:44.366158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 5d716a28995942e788205c1ad1e83bb3 Oct 14 13:06:44.366158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:06:44.366158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-AttachVolumeShelveTestJSON-1446019722-project Oct 14 13:06:44.366158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:06:44.366158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:06:44.366158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 26a54235fb424dfd825b2de9f7aaa006 Oct 14 13:06:44.366158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446019722-project Oct 14 13:06:44.366158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:06:44.366158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. Oct 14 13:06:44.366158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '4bff20a0-76b8-44e6-9f5c-87a9fce18f87'} Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:06:44.367180 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. Oct 14 13:06:44.368546 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:44.370173 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-db8bff57-9c4a-4b7b-8bd2-92b916339055 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Returning 404 to user: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:06:44.370173 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-db8bff57-9c4a-4b7b-8bd2-92b916339055 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 404 len: 111 microversion: 2.20 time: 0.031152 Oct 14 13:06:44.370173 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 392/791] 10.222.0.47 () {60 vars in 1280 bytes} [Fri Oct 14 13:06:44 2022] DELETE /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 13:06:44.373968 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8d5e0d71-03ae-4afa-8720-262eaed9b5f5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:44.374568 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8d5e0d71-03ae-4afa-8720-262eaed9b5f5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: 4bff20a0-76b8-44e6-9f5c-87a9fce18f87] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:44.380360 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d5e0d71-03ae-4afa-8720-262eaed9b5f5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:44.381214 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d5e0d71-03ae-4afa-8720-262eaed9b5f5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:44.381687 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d5e0d71-03ae-4afa-8720-262eaed9b5f5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:44.382399 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d5e0d71-03ae-4afa-8720-262eaed9b5f5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:44.382851 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d5e0d71-03ae-4afa-8720-262eaed9b5f5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:44.383311 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8d5e0d71-03ae-4afa-8720-262eaed9b5f5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:44.397321 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-8d5e0d71-03ae-4afa-8720-262eaed9b5f5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] HTTP exception thrown: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8d5e0d71-03ae-4afa-8720-262eaed9b5f5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Request method failure captured: Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 HTTP/1.1 Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV2GLiiG5lpdVr87nMRGLhHjvG9ei2Ab2yw3BET05lehMn7lWxhZPJhvVW0QyPJg4zwHeSXoKeptZd3lPGMkrdYX7iZyT1b6IQTRIlkqOBTIsV2JzIOoraOorN2U4x-FyJl_VT4YPgsp6hcj_nK7QUE4JvrswjktokYorMze75tXYsA Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 5d716a28995942e788205c1ad1e83bb3 Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:06:44.398867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:06:44.400541 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d716a28995942e788205c1ad1e83bb3", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:06:44.400541 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:06:44.400541 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 5d716a28995942e788205c1ad1e83bb3 Oct 14 13:06:44.400541 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:06:44.400541 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-AttachVolumeShelveTestJSON-1446019722-project Oct 14 13:06:44.400541 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:06:44.400541 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:06:44.400541 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 26a54235fb424dfd825b2de9f7aaa006 Oct 14 13:06:44.400541 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446019722-project Oct 14 13:06:44.400541 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:06:44.400541 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. Oct 14 13:06:44.400541 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '4bff20a0-76b8-44e6-9f5c-87a9fce18f87'} Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:06:44.401396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. Oct 14 13:06:44.402896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:44.404276 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8d5e0d71-03ae-4afa-8720-262eaed9b5f5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Returning 404 to user: Instance 4bff20a0-76b8-44e6-9f5c-87a9fce18f87 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:06:44.404276 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8d5e0d71-03ae-4afa-8720-262eaed9b5f5 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87" status: 404 len: 111 microversion: 2.20 time: 0.029857 Oct 14 13:06:44.404276 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 393/792] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:06:44 2022] GET /compute/v2.1/servers/4bff20a0-76b8-44e6-9f5c-87a9fce18f87 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 14 13:06:44.490094 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-bf581d34-dce9-41a6-ace1-9d2cd7494c56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:44.497933 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-bf581d34-dce9-41a6-ace1-9d2cd7494c56 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.163120 Oct 14 13:06:44.498499 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 400/793] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:44 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:45.520196 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-b695cc9a-0016-4d3a-b92f-025547048950 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:45.520951 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-b695cc9a-0016-4d3a-b92f-025547048950 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:45.527933 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b695cc9a-0016-4d3a-b92f-025547048950 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:45.528417 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b695cc9a-0016-4d3a-b92f-025547048950 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:45.528844 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b695cc9a-0016-4d3a-b92f-025547048950 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:45.529745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b695cc9a-0016-4d3a-b92f-025547048950 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:45.530212 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b695cc9a-0016-4d3a-b92f-025547048950 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:45.530620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b695cc9a-0016-4d3a-b92f-025547048950 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:45.757935 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-b695cc9a-0016-4d3a-b92f-025547048950 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:45.765578 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-b695cc9a-0016-4d3a-b92f-025547048950 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.249197 Oct 14 13:06:45.766141 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 394/794] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:45 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:46.102515 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-8fe7048f-4771-4578-b6eb-e50069d96278 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:46.103201 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-8fe7048f-4771-4578-b6eb-e50069d96278 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:46.115674 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8fe7048f-4771-4578-b6eb-e50069d96278 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:46.119688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8fe7048f-4771-4578-b6eb-e50069d96278 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:46.121333 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8fe7048f-4771-4578-b6eb-e50069d96278 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:46.123571 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8fe7048f-4771-4578-b6eb-e50069d96278 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:46.124247 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8fe7048f-4771-4578-b6eb-e50069d96278 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:46.124899 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8fe7048f-4771-4578-b6eb-e50069d96278 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:46.157319 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-8fe7048f-4771-4578-b6eb-e50069d96278 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Going to try to terminate instance {{(pid=118868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:06:46.264540 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-8fe7048f-4771-4578-b6eb-e50069d96278 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 204 len: 0 microversion: 2.1 time: 0.166902 Oct 14 13:06:46.265126 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 401/795] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:06:46 2022] DELETE /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:06:46.274773 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-42ee75b8-50db-4c99-8beb-c3c93776a22b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:46.275480 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-42ee75b8-50db-4c99-8beb-c3c93776a22b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:46.282541 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-42ee75b8-50db-4c99-8beb-c3c93776a22b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:46.283032 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-42ee75b8-50db-4c99-8beb-c3c93776a22b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:46.283467 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-42ee75b8-50db-4c99-8beb-c3c93776a22b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:46.284171 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-42ee75b8-50db-4c99-8beb-c3c93776a22b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:46.284626 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-42ee75b8-50db-4c99-8beb-c3c93776a22b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:46.285051 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-42ee75b8-50db-4c99-8beb-c3c93776a22b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:46.294224 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-f897c27f-6027-4da1-a33d-7474170220b1 req-e9273e9c-8c34-484d-83ae-a15e0cbca749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f", "tag": "5974c9e5-7b5e-4f03-aaed-db90e7d7a18e"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:06:46.306746 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-f897c27f-6027-4da1-a33d-7474170220b1 req-e9273e9c-8c34-484d-83ae-a15e0cbca749 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:46.307476 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-f897c27f-6027-4da1-a33d-7474170220b1 req-e9273e9c-8c34-484d-83ae-a15e0cbca749 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:46.308082 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-f897c27f-6027-4da1-a33d-7474170220b1 req-e9273e9c-8c34-484d-83ae-a15e0cbca749 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:46.321343 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-f897c27f-6027-4da1-a33d-7474170220b1 req-e9273e9c-8c34-484d-83ae-a15e0cbca749 service nova] Creating event network-changed:5974c9e5-7b5e-4f03-aaed-db90e7d7a18e for instance 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f on hv-cinder-82099 Oct 14 13:06:46.326720 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-f897c27f-6027-4da1-a33d-7474170220b1 req-e9273e9c-8c34-484d-83ae-a15e0cbca749 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218226 Oct 14 13:06:46.327511 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 395/796] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:06:46.426090 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-42ee75b8-50db-4c99-8beb-c3c93776a22b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:46.434678 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-42ee75b8-50db-4c99-8beb-c3c93776a22b tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.164864 Oct 14 13:06:46.435242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 402/797] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:46 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:06:46.790201 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f3a74e73-2207-4e55-9bfc-4aa92ab9c473 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:46.790842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f3a74e73-2207-4e55-9bfc-4aa92ab9c473 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:46.796996 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f3a74e73-2207-4e55-9bfc-4aa92ab9c473 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:46.797495 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f3a74e73-2207-4e55-9bfc-4aa92ab9c473 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:46.797942 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f3a74e73-2207-4e55-9bfc-4aa92ab9c473 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:46.798633 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f3a74e73-2207-4e55-9bfc-4aa92ab9c473 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:46.799082 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f3a74e73-2207-4e55-9bfc-4aa92ab9c473 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:46.799507 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f3a74e73-2207-4e55-9bfc-4aa92ab9c473 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:46.934380 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-f3a74e73-2207-4e55-9bfc-4aa92ab9c473 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:46.942456 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-f3a74e73-2207-4e55-9bfc-4aa92ab9c473 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.157758 Oct 14 13:06:46.943657 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 396/798] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:46 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:47.251404 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-4c113d2c-252c-4945-8d3a-332636e56247 req-c99ca6ca-fa92-4b86-b5b9-0bd83f30e7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62efbcc1-3060-4f79-9a6e-725a62576d91", "name": "network-vif-plugged", "status": "completed", "tag": "4bcf9a4a-8080-4b16-96b8-764c513ef541"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:06:47.266019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-4c113d2c-252c-4945-8d3a-332636e56247 req-c99ca6ca-fa92-4b86-b5b9-0bd83f30e7e6 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:47.266511 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-4c113d2c-252c-4945-8d3a-332636e56247 req-c99ca6ca-fa92-4b86-b5b9-0bd83f30e7e6 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:47.266944 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-4c113d2c-252c-4945-8d3a-332636e56247 req-c99ca6ca-fa92-4b86-b5b9-0bd83f30e7e6 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:47.279298 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-4c113d2c-252c-4945-8d3a-332636e56247 req-c99ca6ca-fa92-4b86-b5b9-0bd83f30e7e6 service nova] Creating event network-vif-plugged:4bcf9a4a-8080-4b16-96b8-764c513ef541 for instance 62efbcc1-3060-4f79-9a6e-725a62576d91 on hv-cinder-82099 Oct 14 13:06:47.284222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-4c113d2c-252c-4945-8d3a-332636e56247 req-c99ca6ca-fa92-4b86-b5b9-0bd83f30e7e6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037186 Oct 14 13:06:47.285168 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 403/799] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:06:47.459170 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4e660516-4f0d-4e89-8cd5-44a3e7a2778f tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:47.459780 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4e660516-4f0d-4e89-8cd5-44a3e7a2778f tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:47.466408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4e660516-4f0d-4e89-8cd5-44a3e7a2778f tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:47.466583 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4e660516-4f0d-4e89-8cd5-44a3e7a2778f tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:47.467017 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4e660516-4f0d-4e89-8cd5-44a3e7a2778f tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:47.467711 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4e660516-4f0d-4e89-8cd5-44a3e7a2778f tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:47.468168 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4e660516-4f0d-4e89-8cd5-44a3e7a2778f tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:47.468591 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4e660516-4f0d-4e89-8cd5-44a3e7a2778f tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:47.601926 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4e660516-4f0d-4e89-8cd5-44a3e7a2778f tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:47.609789 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4e660516-4f0d-4e89-8cd5-44a3e7a2778f tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.154582 Oct 14 13:06:47.610604 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 397/800] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:47 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:47.652169 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9909ca2c-b54e-48d0-bdbc-4b17cff10be4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:47.652749 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-9909ca2c-b54e-48d0-bdbc-4b17cff10be4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:47.658837 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9909ca2c-b54e-48d0-bdbc-4b17cff10be4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:47.659316 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9909ca2c-b54e-48d0-bdbc-4b17cff10be4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:47.659764 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9909ca2c-b54e-48d0-bdbc-4b17cff10be4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:47.660432 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9909ca2c-b54e-48d0-bdbc-4b17cff10be4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:47.660881 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9909ca2c-b54e-48d0-bdbc-4b17cff10be4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:47.661302 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9909ca2c-b54e-48d0-bdbc-4b17cff10be4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:47.674163 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-9909ca2c-b54e-48d0-bdbc-4b17cff10be4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] HTTP exception thrown: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9909ca2c-b54e-48d0-bdbc-4b17cff10be4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Request method failure captured: Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: DELETE /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 HTTP/1.1 Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV2GLiiG5lpdVr87nMRGLhHjvG9ei2Ab2yw3BET05lehMn7lWxhZPJhvVW0QyPJg4zwHeSXoKeptZd3lPGMkrdYX7iZyT1b6IQTRIlkqOBTIsV2JzIOoraOorN2U4x-FyJl_VT4YPgsp6hcj_nK7QUE4JvrswjktokYorMze75tXYsA Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: 5d716a28995942e788205c1ad1e83bb3 Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:06:47.675767 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:06:47.677457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d716a28995942e788205c1ad1e83bb3", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:06:47.677457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:06:47.677457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: 5d716a28995942e788205c1ad1e83bb3 Oct 14 13:06:47.677457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:06:47.677457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-AttachVolumeShelveTestJSON-1446019722-project Oct 14 13:06:47.677457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:06:47.677457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:06:47.677457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 26a54235fb424dfd825b2de9f7aaa006 Oct 14 13:06:47.677457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446019722-project Oct 14 13:06:47.677457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:06:47.677457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. Oct 14 13:06:47.677457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': 'f8f2bb08-a11d-46c6-96f5-9a9f85316fd0'} Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:06:47.678791 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. Oct 14 13:06:47.680428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:06:47.682024 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9909ca2c-b54e-48d0-bdbc-4b17cff10be4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Returning 404 to user: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:06:47.682024 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-9909ca2c-b54e-48d0-bdbc-4b17cff10be4 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 404 len: 111 microversion: 2.20 time: 0.029384 Oct 14 13:06:47.682024 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 404/801] 10.222.0.47 () {60 vars in 1280 bytes} [Fri Oct 14 13:06:47 2022] DELETE /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 13:06:47.685640 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c40bd2ec-6240-4efc-986d-066e11f89662 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:47.686242 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c40bd2ec-6240-4efc-986d-066e11f89662 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] [instance: f8f2bb08-a11d-46c6-96f5-9a9f85316fd0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:47.692067 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c40bd2ec-6240-4efc-986d-066e11f89662 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:47.692537 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c40bd2ec-6240-4efc-986d-066e11f89662 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:47.693541 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c40bd2ec-6240-4efc-986d-066e11f89662 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:47.694225 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c40bd2ec-6240-4efc-986d-066e11f89662 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:47.694670 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c40bd2ec-6240-4efc-986d-066e11f89662 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:47.695086 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c40bd2ec-6240-4efc-986d-066e11f89662 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:47.708201 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-c40bd2ec-6240-4efc-986d-066e11f89662 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] HTTP exception thrown: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c40bd2ec-6240-4efc-986d-066e11f89662 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Request method failure captured: Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 HTTP/1.1 Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV2GLiiG5lpdVr87nMRGLhHjvG9ei2Ab2yw3BET05lehMn7lWxhZPJhvVW0QyPJg4zwHeSXoKeptZd3lPGMkrdYX7iZyT1b6IQTRIlkqOBTIsV2JzIOoraOorN2U4x-FyJl_VT4YPgsp6hcj_nK7QUE4JvrswjktokYorMze75tXYsA Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Openstack-Nova-Api-Version: 2.20 Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 5d716a28995942e788205c1ad1e83bb3 Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:06:47.710408 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:06:47.712128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d716a28995942e788205c1ad1e83bb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d716a28995942e788205c1ad1e83bb3", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:06:47.712128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:06:47.712128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 5d716a28995942e788205c1ad1e83bb3 Oct 14 13:06:47.712128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1446019722 Oct 14 13:06:47.712128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-AttachVolumeShelveTestJSON-1446019722-project Oct 14 13:06:47.712128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:06:47.712128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:06:47.712128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 26a54235fb424dfd825b2de9f7aaa006 Oct 14 13:06:47.712128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1446019722-project Oct 14 13:06:47.712128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:06:47.712128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. Oct 14 13:06:47.712128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': 'f8f2bb08-a11d-46c6-96f5-9a9f85316fd0'} Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:06:47.713048 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. Oct 14 13:06:47.714654 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:47.716288 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c40bd2ec-6240-4efc-986d-066e11f89662 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] Returning 404 to user: Instance f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:06:47.716288 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c40bd2ec-6240-4efc-986d-066e11f89662 tempest-AttachVolumeShelveTestJSON-1446019722 tempest-AttachVolumeShelveTestJSON-1446019722-project] 10.222.0.47 "GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0" status: 404 len: 111 microversion: 2.20 time: 0.029997 Oct 14 13:06:47.716288 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 398/802] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Oct 14 13:06:47 2022] GET /compute/v2.1/servers/f8f2bb08-a11d-46c6-96f5-9a9f85316fd0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 14 13:06:47.965909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e4dd10de-7545-4c63-bb19-575829084c86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:47.966529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e4dd10de-7545-4c63-bb19-575829084c86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:47.972470 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e4dd10de-7545-4c63-bb19-575829084c86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:47.972956 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e4dd10de-7545-4c63-bb19-575829084c86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:47.973393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e4dd10de-7545-4c63-bb19-575829084c86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:47.974119 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e4dd10de-7545-4c63-bb19-575829084c86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:47.974579 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e4dd10de-7545-4c63-bb19-575829084c86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:47.975014 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e4dd10de-7545-4c63-bb19-575829084c86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:48.212688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e4dd10de-7545-4c63-bb19-575829084c86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:48.225060 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e4dd10de-7545-4c63-bb19-575829084c86 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.263101 Oct 14 13:06:48.225695 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 405/803] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:47 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:48.632358 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-fdace200-2afc-46d8-bea5-af5d46d9de87 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:48.632888 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-fdace200-2afc-46d8-bea5-af5d46d9de87 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:48.639502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdace200-2afc-46d8-bea5-af5d46d9de87 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:48.640285 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdace200-2afc-46d8-bea5-af5d46d9de87 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:48.640724 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdace200-2afc-46d8-bea5-af5d46d9de87 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:48.641432 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdace200-2afc-46d8-bea5-af5d46d9de87 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:48.641916 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdace200-2afc-46d8-bea5-af5d46d9de87 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:48.642341 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fdace200-2afc-46d8-bea5-af5d46d9de87 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:48.907553 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-fdace200-2afc-46d8-bea5-af5d46d9de87 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:48.917176 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-fdace200-2afc-46d8-bea5-af5d46d9de87 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1568 microversion: 2.1 time: 0.288705 Oct 14 13:06:48.918384 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 399/804] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:48 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1568 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:49.248196 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4f60e21d-cfb3-4189-8aad-366c89475108 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:49.248821 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-4f60e21d-cfb3-4189-8aad-366c89475108 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:49.257257 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4f60e21d-cfb3-4189-8aad-366c89475108 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:49.257780 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4f60e21d-cfb3-4189-8aad-366c89475108 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:49.258224 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4f60e21d-cfb3-4189-8aad-366c89475108 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:49.258932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4f60e21d-cfb3-4189-8aad-366c89475108 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:49.259392 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4f60e21d-cfb3-4189-8aad-366c89475108 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:49.259820 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4f60e21d-cfb3-4189-8aad-366c89475108 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:49.437355 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-76f4e663-3ac0-42d1-b797-a6b5de749c39 req-09d218ed-8a9f-4270-b290-5286cbb25c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f", "name": "network-vif-deleted", "tag": "5974c9e5-7b5e-4f03-aaed-db90e7d7a18e"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:06:49.454884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-76f4e663-3ac0-42d1-b797-a6b5de749c39 req-09d218ed-8a9f-4270-b290-5286cbb25c04 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:49.455558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-76f4e663-3ac0-42d1-b797-a6b5de749c39 req-09d218ed-8a9f-4270-b290-5286cbb25c04 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:49.457628 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-76f4e663-3ac0-42d1-b797-a6b5de749c39 req-09d218ed-8a9f-4270-b290-5286cbb25c04 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:49.488042 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-76f4e663-3ac0-42d1-b797-a6b5de749c39 req-09d218ed-8a9f-4270-b290-5286cbb25c04 service nova] Creating event network-vif-deleted:5974c9e5-7b5e-4f03-aaed-db90e7d7a18e for instance 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f on hv-cinder-82099 Oct 14 13:06:49.494631 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-76f4e663-3ac0-42d1-b797-a6b5de749c39 req-09d218ed-8a9f-4270-b290-5286cbb25c04 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062838 Oct 14 13:06:49.495509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 400/805] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:06:49.722053 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-4f60e21d-cfb3-4189-8aad-366c89475108 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:49.730973 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4f60e21d-cfb3-4189-8aad-366c89475108 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1358 microversion: 2.1 time: 0.486551 Oct 14 13:06:49.734609 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 406/806] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:49 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1358 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:49.941056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-dcf7dedb-f782-430e-8288-3c93d334f2ff tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:49.942403 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-dcf7dedb-f782-430e-8288-3c93d334f2ff tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:49.955330 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dcf7dedb-f782-430e-8288-3c93d334f2ff tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:49.957104 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dcf7dedb-f782-430e-8288-3c93d334f2ff tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:49.957736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dcf7dedb-f782-430e-8288-3c93d334f2ff tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:49.959399 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dcf7dedb-f782-430e-8288-3c93d334f2ff tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:49.960315 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dcf7dedb-f782-430e-8288-3c93d334f2ff tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:49.961327 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-dcf7dedb-f782-430e-8288-3c93d334f2ff tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:50.066081 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-dcf7dedb-f782-430e-8288-3c93d334f2ff tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:50.079511 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-dcf7dedb-f782-430e-8288-3c93d334f2ff tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1218 microversion: 2.1 time: 0.141374 Oct 14 13:06:50.080403 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 401/807] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:49 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1218 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:50.756397 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d2b5b48d-8303-40bd-8b6c-6facaa9679e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:50.757014 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-d2b5b48d-8303-40bd-8b6c-6facaa9679e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:50.770865 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d2b5b48d-8303-40bd-8b6c-6facaa9679e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:50.772028 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d2b5b48d-8303-40bd-8b6c-6facaa9679e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:50.773038 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d2b5b48d-8303-40bd-8b6c-6facaa9679e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:50.776655 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d2b5b48d-8303-40bd-8b6c-6facaa9679e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:50.777716 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d2b5b48d-8303-40bd-8b6c-6facaa9679e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:50.779237 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d2b5b48d-8303-40bd-8b6c-6facaa9679e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:51.032741 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-d2b5b48d-8303-40bd-8b6c-6facaa9679e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:51.041216 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-d2b5b48d-8303-40bd-8b6c-6facaa9679e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1547 microversion: 2.1 time: 0.288760 Oct 14 13:06:51.057963 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 407/808] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:50 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1547 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:51.064399 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-39a0fa24-835f-46f3-953b-ec94288f0740 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:51.065587 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-39a0fa24-835f-46f3-953b-ec94288f0740 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:51.072561 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39a0fa24-835f-46f3-953b-ec94288f0740 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:51.073045 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39a0fa24-835f-46f3-953b-ec94288f0740 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:51.073877 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39a0fa24-835f-46f3-953b-ec94288f0740 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:51.074744 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39a0fa24-835f-46f3-953b-ec94288f0740 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:51.075346 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39a0fa24-835f-46f3-953b-ec94288f0740 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:51.075998 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39a0fa24-835f-46f3-953b-ec94288f0740 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:51.105121 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-20a169c5-b4cd-4452-b7ef-27ca1b68d1f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:51.106205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-20a169c5-b4cd-4452-b7ef-27ca1b68d1f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:51.115095 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-20a169c5-b4cd-4452-b7ef-27ca1b68d1f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:51.116840 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-20a169c5-b4cd-4452-b7ef-27ca1b68d1f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:51.122963 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-20a169c5-b4cd-4452-b7ef-27ca1b68d1f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:51.124893 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-20a169c5-b4cd-4452-b7ef-27ca1b68d1f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:51.125717 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-20a169c5-b4cd-4452-b7ef-27ca1b68d1f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:51.126320 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-20a169c5-b4cd-4452-b7ef-27ca1b68d1f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:51.245828 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-20a169c5-b4cd-4452-b7ef-27ca1b68d1f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:51.256928 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-20a169c5-b4cd-4452-b7ef-27ca1b68d1f6 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1218 microversion: 2.1 time: 0.155772 Oct 14 13:06:51.257745 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 408/809] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:51 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1218 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:06:51.356419 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-39a0fa24-835f-46f3-953b-ec94288f0740 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:51.365277 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-39a0fa24-835f-46f3-953b-ec94288f0740 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1547 microversion: 2.1 time: 0.304694 Oct 14 13:06:51.366433 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 402/810] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:51 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1547 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:06:51.389080 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-599d9c43-804b-45d6-8a0f-64900bd0847f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:51.394684 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-599d9c43-804b-45d6-8a0f-64900bd0847f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:51.395787 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-599d9c43-804b-45d6-8a0f-64900bd0847f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Searching by: {'deleted': False, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc'} {{(pid=118868) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 14 13:06:51.403817 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-599d9c43-804b-45d6-8a0f-64900bd0847f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:51.404554 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-599d9c43-804b-45d6-8a0f-64900bd0847f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:51.405225 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-599d9c43-804b-45d6-8a0f-64900bd0847f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:51.406824 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-599d9c43-804b-45d6-8a0f-64900bd0847f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:51.407351 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-599d9c43-804b-45d6-8a0f-64900bd0847f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:51.407849 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-599d9c43-804b-45d6-8a0f-64900bd0847f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:51.507778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.multi_cell_list [None req-599d9c43-804b-45d6-8a0f-64900bd0847f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118868) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 14 13:06:51.628292 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-599d9c43-804b-45d6-8a0f-64900bd0847f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.243109 Oct 14 13:06:51.629005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 409/811] 10.222.0.47 () {58 vars in 1125 bytes} [Fri Oct 14 13:06:51 2022] GET /compute/v2.1/servers => generated 342 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:06:51.642158 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-30518f16-ad62-4966-ae7f-aab4c29074b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:51.642970 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-30518f16-ad62-4966-ae7f-aab4c29074b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:51.650420 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-30518f16-ad62-4966-ae7f-aab4c29074b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:51.651129 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-30518f16-ad62-4966-ae7f-aab4c29074b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:51.651724 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-30518f16-ad62-4966-ae7f-aab4c29074b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:51.652593 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-30518f16-ad62-4966-ae7f-aab4c29074b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:51.653262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-30518f16-ad62-4966-ae7f-aab4c29074b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:51.653890 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-30518f16-ad62-4966-ae7f-aab4c29074b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:52.187554 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-30518f16-ad62-4966-ae7f-aab4c29074b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:52.202627 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-30518f16-ad62-4966-ae7f-aab4c29074b3 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1547 microversion: 2.1 time: 0.565241 Oct 14 13:06:52.203493 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 403/812] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:51 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1547 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:52.281781 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f4c5c407-2a3e-4526-aea6-7a57f7a8c38c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:52.282762 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-f4c5c407-2a3e-4526-aea6-7a57f7a8c38c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:52.313103 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f4c5c407-2a3e-4526-aea6-7a57f7a8c38c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:52.313686 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f4c5c407-2a3e-4526-aea6-7a57f7a8c38c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:52.314140 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f4c5c407-2a3e-4526-aea6-7a57f7a8c38c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:52.314872 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f4c5c407-2a3e-4526-aea6-7a57f7a8c38c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:52.315502 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f4c5c407-2a3e-4526-aea6-7a57f7a8c38c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:52.316102 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f4c5c407-2a3e-4526-aea6-7a57f7a8c38c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:52.623143 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f4c5c407-2a3e-4526-aea6-7a57f7a8c38c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:52.631714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f4c5c407-2a3e-4526-aea6-7a57f7a8c38c tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1218 microversion: 2.1 time: 0.354250 Oct 14 13:06:52.632858 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 410/813] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:52 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1218 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:53.469360 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1235508197", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "networks": [{"uuid": "4b48ab87-d6cc-4767-87d8-461a19c349f8"}]}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:06:53.540660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.network.neutron [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] validate_networks() for [('4b48ab87-d6cc-4767-87d8-461a19c349f8', None, None, None, None, None)] {{(pid=118869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:06:53.655479 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-bdfef721-2a21-488a-801a-825e27142f74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:53.656243 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-bdfef721-2a21-488a-801a-825e27142f74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:53.663375 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bdfef721-2a21-488a-801a-825e27142f74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:53.664170 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bdfef721-2a21-488a-801a-825e27142f74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:53.664705 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bdfef721-2a21-488a-801a-825e27142f74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:53.665711 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bdfef721-2a21-488a-801a-825e27142f74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:53.666268 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bdfef721-2a21-488a-801a-825e27142f74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:53.666796 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bdfef721-2a21-488a-801a-825e27142f74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:53.699534 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bdfef721-2a21-488a-801a-825e27142f74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:53.700134 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bdfef721-2a21-488a-801a-825e27142f74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:53.700753 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-bdfef721-2a21-488a-801a-825e27142f74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:53.701369 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.objects.instance [None req-bdfef721-2a21-488a-801a-825e27142f74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lazy-loading 'fault' on Instance uuid 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f {{(pid=118868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:06:53.747269 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-bdfef721-2a21-488a-801a-825e27142f74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'accfa9fc356a4ccca7332118e8b9c421', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97fa795966724ea89be8ac20675b589b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:53.756195 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-bdfef721-2a21-488a-801a-825e27142f74 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 200 len: 1386 microversion: 2.1 time: 0.104606 Oct 14 13:06:53.766856 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 411/814] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:53 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 1386 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:06:53.956785 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Flavor limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:06:53.957425 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Image limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:06:53.958269 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Flavor pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:06:53.959809 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Image pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:06:53.960783 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:06:53.978125 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:53.978752 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:53.979204 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:53.979988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:53.980445 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:53.982435 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:54.011785 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Getting quotas for project ced93fb9d5dd4cbda0272ba5477b39c9. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:06:54.015919 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Getting quotas for user 52ef0190e0854ed1b9b1e08224e7390d and project ced93fb9d5dd4cbda0272ba5477b39c9. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:06:54.027856 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Going to run 1 instances... {{(pid=118869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:06:54.030317 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:06:54.058565 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4cebf860-007c-4f07-aad7-0a07281cae6f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff770f67-5986-4d6c-995b-b8029c57c919"}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:06:54.060971 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-4cebf860-007c-4f07-aad7-0a07281cae6f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:54.069277 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4cebf860-007c-4f07-aad7-0a07281cae6f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:54.069811 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4cebf860-007c-4f07-aad7-0a07281cae6f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:54.070267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4cebf860-007c-4f07-aad7-0a07281cae6f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:54.071012 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4cebf860-007c-4f07-aad7-0a07281cae6f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:54.071473 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4cebf860-007c-4f07-aad7-0a07281cae6f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:54.071902 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4cebf860-007c-4f07-aad7-0a07281cae6f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:54.087766 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-61682a25-d964-444c-9e8c-460b318f557b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622886 Oct 14 13:06:54.093663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 404/815] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:06:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 13:06:54.101407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cb61bc44-b3b5-4060-9e39-b67ffc95c2bd tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:54.102159 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-cb61bc44-b3b5-4060-9e39-b67ffc95c2bd tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:54.153335 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:06:54.176455 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-cb61bc44-b3b5-4060-9e39-b67ffc95c2bd tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:54.186475 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-cb61bc44-b3b5-4060-9e39-b67ffc95c2bd tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1214 microversion: 2.1 time: 0.090875 Oct 14 13:06:54.187434 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 405/816] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:54 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:06:54.394441 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4cebf860-007c-4f07-aad7-0a07281cae6f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "POST /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339884 Oct 14 13:06:54.395593 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 412/817] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Oct 14 13:06:54 2022] POST /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:06:55.002746 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-34cd1750-e045-4740-8e5c-c4b2313884de tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:55.004160 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-34cd1750-e045-4740-8e5c-c4b2313884de tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] [instance: 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:55.011356 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34cd1750-e045-4740-8e5c-c4b2313884de tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:55.012122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34cd1750-e045-4740-8e5c-c4b2313884de tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:55.012912 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34cd1750-e045-4740-8e5c-c4b2313884de tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:55.013658 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34cd1750-e045-4740-8e5c-c4b2313884de tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:55.014132 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34cd1750-e045-4740-8e5c-c4b2313884de tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:55.014557 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-34cd1750-e045-4740-8e5c-c4b2313884de tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:55.032434 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-34cd1750-e045-4740-8e5c-c4b2313884de tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] HTTP exception thrown: Instance 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f could not be found. Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-34cd1750-e045-4740-8e5c-c4b2313884de tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Request method failure captured: Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f HTTP/1.1 Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV24zswIk1wd_UjKcoSmG3taICfcQ_ccfPSHytWSPco2PMMajRWkWTbMoTYnNjW-3jEfE_5L9aVlz2A4RapR-7ntcqjKGlQQKg0dEvw9wOKVjMIUVvE-ooc5sOyMuEaed46KU6wFbYRBpMlRQ6dsNC474gPowzmHAgSVkA2qsGLpFfM Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: 97fa795966724ea89be8ac20675b589b Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-TestShelveInstance-1946983482 Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:06:55.034140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:06:55.035842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/97fa795966724ea89be8ac20675b589b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/97fa795966724ea89be8ac20675b589b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/97fa795966724ea89be8ac20675b589b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_97fa795966724ea89be8ac20675b589b", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:06:55.035842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-TestShelveInstance-1946983482 Oct 14 13:06:55.035842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: 97fa795966724ea89be8ac20675b589b Oct 14 13:06:55.035842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-TestShelveInstance-1946983482 Oct 14 13:06:55.035842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-TestShelveInstance-1946983482-project Oct 14 13:06:55.035842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:06:55.035842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:06:55.035842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: accfa9fc356a4ccca7332118e8b9c421 Oct 14 13:06:55.035842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-TestShelveInstance-1946983482-project Oct 14 13:06:55.035842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:06:55.035842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f could not be found. Oct 14 13:06:55.035842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f'} Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f could not be found. Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:06:55.037462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f could not be found. Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f could not be found. Oct 14 13:06:55.039096 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:06:55.040600 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-34cd1750-e045-4740-8e5c-c4b2313884de tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Returning 404 to user: Instance 3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:06:55.040600 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-34cd1750-e045-4740-8e5c-c4b2313884de tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f" status: 404 len: 111 microversion: 2.1 time: 0.259094 Oct 14 13:06:55.040600 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 406/818] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:54 2022] GET /compute/v2.1/servers/3a883e2c-b1b9-4cf7-9fa1-ae420e88ac3f => generated 111 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 13:06:55.211274 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-293f49eb-6cdd-4fd8-87a2-5cbb88be1857 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] Calling method '.version_select at 0x7fbb81985b80>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:55.215443 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-39ed1a87-2d48-4ed2-a605-2879cadb0c6f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:55.216833 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-39ed1a87-2d48-4ed2-a605-2879cadb0c6f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:55.224388 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39ed1a87-2d48-4ed2-a605-2879cadb0c6f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:55.226711 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39ed1a87-2d48-4ed2-a605-2879cadb0c6f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:55.227122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39ed1a87-2d48-4ed2-a605-2879cadb0c6f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:55.228063 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39ed1a87-2d48-4ed2-a605-2879cadb0c6f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:55.228808 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39ed1a87-2d48-4ed2-a605-2879cadb0c6f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:55.229452 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-39ed1a87-2d48-4ed2-a605-2879cadb0c6f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:55.262889 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-293f49eb-6cdd-4fd8-87a2-5cbb88be1857 tempest-TestShelveInstance-1946983482 tempest-TestShelveInstance-1946983482-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-540998058" status: 202 len: 0 microversion: 2.1 time: 0.065927 Oct 14 13:06:55.267890 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 413/819] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Oct 14 13:06:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-540998058 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:06:55.332722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-39ed1a87-2d48-4ed2-a605-2879cadb0c6f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:55.343342 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-39ed1a87-2d48-4ed2-a605-2879cadb0c6f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1266 microversion: 2.1 time: 0.135790 Oct 14 13:06:55.343987 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 407/820] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:55 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:06:56.367835 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5ce215a8-5f65-4321-8414-f83270dd4efb tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:56.368581 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5ce215a8-5f65-4321-8414-f83270dd4efb tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:56.375432 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ce215a8-5f65-4321-8414-f83270dd4efb tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:56.375913 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ce215a8-5f65-4321-8414-f83270dd4efb tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:56.376341 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ce215a8-5f65-4321-8414-f83270dd4efb tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:56.377032 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ce215a8-5f65-4321-8414-f83270dd4efb tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:56.377505 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ce215a8-5f65-4321-8414-f83270dd4efb tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:56.377928 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ce215a8-5f65-4321-8414-f83270dd4efb tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:56.479467 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5ce215a8-5f65-4321-8414-f83270dd4efb tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:56.487340 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5ce215a8-5f65-4321-8414-f83270dd4efb tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1272 microversion: 2.1 time: 0.124158 Oct 14 13:06:56.487917 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 414/821] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:56 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:57.510116 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-95c96627-2baf-4fa3-8833-00a2c5d9c8cc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:57.511272 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-95c96627-2baf-4fa3-8833-00a2c5d9c8cc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:57.519530 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-95c96627-2baf-4fa3-8833-00a2c5d9c8cc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:57.520237 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-95c96627-2baf-4fa3-8833-00a2c5d9c8cc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:57.520996 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-95c96627-2baf-4fa3-8833-00a2c5d9c8cc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:57.521905 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-95c96627-2baf-4fa3-8833-00a2c5d9c8cc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:57.522543 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-95c96627-2baf-4fa3-8833-00a2c5d9c8cc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:57.523140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-95c96627-2baf-4fa3-8833-00a2c5d9c8cc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:57.701436 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-95c96627-2baf-4fa3-8833-00a2c5d9c8cc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:57.711013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-95c96627-2baf-4fa3-8833-00a2c5d9c8cc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1314 microversion: 2.1 time: 0.204594 Oct 14 13:06:57.713722 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 408/822] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:57 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:06:58.146859 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-789aa262-0a34-41f4-890f-d1da9bd1756c req-840599d9-6248-4a33-80a3-89b35fc34799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d015c622-b092-4144-a58e-602bb12e37b4", "tag": "ccdfe78c-36a5-4ffb-8518-874e6fcc778e"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:06:58.179142 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-789aa262-0a34-41f4-890f-d1da9bd1756c req-840599d9-6248-4a33-80a3-89b35fc34799 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:58.179927 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-789aa262-0a34-41f4-890f-d1da9bd1756c req-840599d9-6248-4a33-80a3-89b35fc34799 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:58.180520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-789aa262-0a34-41f4-890f-d1da9bd1756c req-840599d9-6248-4a33-80a3-89b35fc34799 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:58.219879 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-789aa262-0a34-41f4-890f-d1da9bd1756c req-840599d9-6248-4a33-80a3-89b35fc34799 service nova] Creating event network-changed:ccdfe78c-36a5-4ffb-8518-874e6fcc778e for instance d015c622-b092-4144-a58e-602bb12e37b4 on hv-cinder-82099 Oct 14 13:06:58.236546 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-789aa262-0a34-41f4-890f-d1da9bd1756c req-840599d9-6248-4a33-80a3-89b35fc34799 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111712 Oct 14 13:06:58.237586 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 415/823] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:06:58.746509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-896d9844-df12-44cd-b92d-65e00dac2262 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:06:58.747321 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-896d9844-df12-44cd-b92d-65e00dac2262 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:06:58.758476 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-896d9844-df12-44cd-b92d-65e00dac2262 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:58.762390 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-896d9844-df12-44cd-b92d-65e00dac2262 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:58.762920 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-896d9844-df12-44cd-b92d-65e00dac2262 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:58.763754 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-896d9844-df12-44cd-b92d-65e00dac2262 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:06:58.764376 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-896d9844-df12-44cd-b92d-65e00dac2262 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:06:58.765798 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-896d9844-df12-44cd-b92d-65e00dac2262 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:06:59.070798 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-896d9844-df12-44cd-b92d-65e00dac2262 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:06:59.082741 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-896d9844-df12-44cd-b92d-65e00dac2262 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1314 microversion: 2.1 time: 0.340536 Oct 14 13:06:59.087298 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 409/824] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:06:58 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:00.112707 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-cdc4aa37-8fa2-4934-b3a5-a9f860f7b735 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:00.114175 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-cdc4aa37-8fa2-4934-b3a5-a9f860f7b735 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:00.122679 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cdc4aa37-8fa2-4934-b3a5-a9f860f7b735 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:00.123340 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cdc4aa37-8fa2-4934-b3a5-a9f860f7b735 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:00.124078 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cdc4aa37-8fa2-4934-b3a5-a9f860f7b735 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:00.125168 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cdc4aa37-8fa2-4934-b3a5-a9f860f7b735 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:00.125829 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cdc4aa37-8fa2-4934-b3a5-a9f860f7b735 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:00.126417 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-cdc4aa37-8fa2-4934-b3a5-a9f860f7b735 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:00.402522 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-cdc4aa37-8fa2-4934-b3a5-a9f860f7b735 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:00.411863 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-cdc4aa37-8fa2-4934-b3a5-a9f860f7b735 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1314 microversion: 2.1 time: 0.304145 Oct 14 13:07:00.412573 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 416/825] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:00 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:01.292603 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2c41597c-2c08-4e82-b071-9d380ff1849a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:01.293402 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-2c41597c-2c08-4e82-b071-9d380ff1849a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:01.300847 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2c41597c-2c08-4e82-b071-9d380ff1849a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:01.301334 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2c41597c-2c08-4e82-b071-9d380ff1849a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:01.301845 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2c41597c-2c08-4e82-b071-9d380ff1849a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:01.302555 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2c41597c-2c08-4e82-b071-9d380ff1849a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:01.303184 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2c41597c-2c08-4e82-b071-9d380ff1849a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:01.303603 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2c41597c-2c08-4e82-b071-9d380ff1849a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:01.444841 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1f29a114-0cfb-4f33-a109-f9c53a033333 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:01.445440 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1f29a114-0cfb-4f33-a109-f9c53a033333 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:01.452330 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=2 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:01.454353 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f29a114-0cfb-4f33-a109-f9c53a033333 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:01.455142 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f29a114-0cfb-4f33-a109-f9c53a033333 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:01.455876 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f29a114-0cfb-4f33-a109-f9c53a033333 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:01.456757 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f29a114-0cfb-4f33-a109-f9c53a033333 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:01.457383 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f29a114-0cfb-4f33-a109-f9c53a033333 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:01.458566 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1f29a114-0cfb-4f33-a109-f9c53a033333 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:01.554197 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-2c41597c-2c08-4e82-b071-9d380ff1849a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:01.564331 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-2c41597c-2c08-4e82-b071-9d380ff1849a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1593 microversion: 2.1 time: 0.275556 Oct 14 13:07:01.593644 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 410/826] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:01 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1593 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:01.734629 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-1f29a114-0cfb-4f33-a109-f9c53a033333 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:01.746381 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1f29a114-0cfb-4f33-a109-f9c53a033333 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1314 microversion: 2.1 time: 0.311698 Oct 14 13:07:01.746866 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 417/827] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:01 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:07:02.773593 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-54019a09-8827-45b1-bc37-3a92e8504da7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:02.774207 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-54019a09-8827-45b1-bc37-3a92e8504da7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:02.783661 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54019a09-8827-45b1-bc37-3a92e8504da7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:02.786871 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54019a09-8827-45b1-bc37-3a92e8504da7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:02.787324 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54019a09-8827-45b1-bc37-3a92e8504da7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:02.788185 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54019a09-8827-45b1-bc37-3a92e8504da7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:02.788844 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54019a09-8827-45b1-bc37-3a92e8504da7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:02.789455 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-54019a09-8827-45b1-bc37-3a92e8504da7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:03.424171 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-54019a09-8827-45b1-bc37-3a92e8504da7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:03.441745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-54019a09-8827-45b1-bc37-3a92e8504da7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1314 microversion: 2.1 time: 0.670430 Oct 14 13:07:03.444011 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 411/828] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:02 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:04.028311 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-d3d1cd78-0e52-43d2-9f6c-843fe7e7371f req-1cfcbad8-8cf9-430c-a94e-d5dd1d04556c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62efbcc1-3060-4f79-9a6e-725a62576d91", "tag": "4bcf9a4a-8080-4b16-96b8-764c513ef541"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:07:04.043590 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-d3d1cd78-0e52-43d2-9f6c-843fe7e7371f req-1cfcbad8-8cf9-430c-a94e-d5dd1d04556c service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:04.044218 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-d3d1cd78-0e52-43d2-9f6c-843fe7e7371f req-1cfcbad8-8cf9-430c-a94e-d5dd1d04556c service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:04.044654 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-d3d1cd78-0e52-43d2-9f6c-843fe7e7371f req-1cfcbad8-8cf9-430c-a94e-d5dd1d04556c service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:04.064367 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-d3d1cd78-0e52-43d2-9f6c-843fe7e7371f req-1cfcbad8-8cf9-430c-a94e-d5dd1d04556c service nova] Creating event network-changed:4bcf9a4a-8080-4b16-96b8-764c513ef541 for instance 62efbcc1-3060-4f79-9a6e-725a62576d91 on hv-cinder-82099 Oct 14 13:07:04.074815 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-d3d1cd78-0e52-43d2-9f6c-843fe7e7371f req-1cfcbad8-8cf9-430c-a94e-d5dd1d04556c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052179 Oct 14 13:07:04.092334 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 418/829] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:07:04.467453 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-51a117a5-2131-4e37-be33-edeeb5621888 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:04.468461 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-51a117a5-2131-4e37-be33-edeeb5621888 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:04.471409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:04.473384 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=8 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:04.500154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-51a117a5-2131-4e37-be33-edeeb5621888 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:04.502855 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-51a117a5-2131-4e37-be33-edeeb5621888 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:04.503697 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-51a117a5-2131-4e37-be33-edeeb5621888 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:04.506179 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-51a117a5-2131-4e37-be33-edeeb5621888 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:04.510162 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-51a117a5-2131-4e37-be33-edeeb5621888 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:04.510752 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-51a117a5-2131-4e37-be33-edeeb5621888 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:04.905795 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-51a117a5-2131-4e37-be33-edeeb5621888 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:04.919769 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-51a117a5-2131-4e37-be33-edeeb5621888 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1314 microversion: 2.1 time: 0.457126 Oct 14 13:07:04.923806 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 412/830] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:04 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:05.947917 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-89a74e3b-e37b-49e1-8705-73ed3979222b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:05.949354 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-89a74e3b-e37b-49e1-8705-73ed3979222b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:05.956670 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-89a74e3b-e37b-49e1-8705-73ed3979222b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:05.957427 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-89a74e3b-e37b-49e1-8705-73ed3979222b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:05.958718 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-89a74e3b-e37b-49e1-8705-73ed3979222b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:05.962304 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-89a74e3b-e37b-49e1-8705-73ed3979222b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:05.963033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-89a74e3b-e37b-49e1-8705-73ed3979222b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:05.963639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-89a74e3b-e37b-49e1-8705-73ed3979222b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:06.372008 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-89a74e3b-e37b-49e1-8705-73ed3979222b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:06.389960 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-89a74e3b-e37b-49e1-8705-73ed3979222b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1314 microversion: 2.1 time: 0.446072 Oct 14 13:07:06.390893 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 419/831] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:05 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:06.418721 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0e61b4c5-b90e-44b2-800d-1bfc02c8177a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1354648957"}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:07:06.419272 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-0e61b4c5-b90e-44b2-800d-1bfc02c8177a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:06.425704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0e61b4c5-b90e-44b2-800d-1bfc02c8177a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:06.426198 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0e61b4c5-b90e-44b2-800d-1bfc02c8177a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:06.427236 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0e61b4c5-b90e-44b2-800d-1bfc02c8177a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:06.427945 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0e61b4c5-b90e-44b2-800d-1bfc02c8177a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:06.428537 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0e61b4c5-b90e-44b2-800d-1bfc02c8177a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:06.428971 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0e61b4c5-b90e-44b2-800d-1bfc02c8177a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:06.444736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=100 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:06.563477 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.network.security_group_api [None req-0e61b4c5-b90e-44b2-800d-1bfc02c8177a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Adding security group 0bdcc557-14cd-4de6-b422-2ca94b79a230 to port 4bcf9a4a-8080-4b16-96b8-764c513ef541 Oct 14 13:07:06.899306 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-0e61b4c5-b90e-44b2-800d-1bfc02c8177a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "POST /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/action" status: 202 len: 0 microversion: 2.1 time: 0.485018 Oct 14 13:07:06.899907 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 413/832] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Oct 14 13:07:06 2022] POST /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:07:06.907973 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5b6e8a4e-23df-4b3a-b868-811b77564436 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:06.908733 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5b6e8a4e-23df-4b3a-b868-811b77564436 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:06.917511 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b6e8a4e-23df-4b3a-b868-811b77564436 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:06.917999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b6e8a4e-23df-4b3a-b868-811b77564436 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:06.924435 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-54648aff-82ae-41fd-96c2-b4798209bfe6 req-f939b6ad-215d-4efd-88b3-b2bfe629a6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62efbcc1-3060-4f79-9a6e-725a62576d91", "tag": "4bcf9a4a-8080-4b16-96b8-764c513ef541"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:07:06.930883 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b6e8a4e-23df-4b3a-b868-811b77564436 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:06.931944 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b6e8a4e-23df-4b3a-b868-811b77564436 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:06.934146 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b6e8a4e-23df-4b3a-b868-811b77564436 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:06.936385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5b6e8a4e-23df-4b3a-b868-811b77564436 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:06.943014 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-54648aff-82ae-41fd-96c2-b4798209bfe6 req-f939b6ad-215d-4efd-88b3-b2bfe629a6c3 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:06.943809 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-54648aff-82ae-41fd-96c2-b4798209bfe6 req-f939b6ad-215d-4efd-88b3-b2bfe629a6c3 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:06.944480 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-54648aff-82ae-41fd-96c2-b4798209bfe6 req-f939b6ad-215d-4efd-88b3-b2bfe629a6c3 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:06.968741 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-54648aff-82ae-41fd-96c2-b4798209bfe6 req-f939b6ad-215d-4efd-88b3-b2bfe629a6c3 service nova] Creating event network-changed:4bcf9a4a-8080-4b16-96b8-764c513ef541 for instance 62efbcc1-3060-4f79-9a6e-725a62576d91 on hv-cinder-82099 Oct 14 13:07:06.988044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-54648aff-82ae-41fd-96c2-b4798209bfe6 req-f939b6ad-215d-4efd-88b3-b2bfe629a6c3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067576 Oct 14 13:07:06.989882 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 414/833] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:07:07.106537 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5b6e8a4e-23df-4b3a-b868-811b77564436 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:07.116273 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5b6e8a4e-23df-4b3a-b868-811b77564436 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1758 microversion: 2.1 time: 0.212077 Oct 14 13:07:07.116949 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 420/834] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:06 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1758 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:07.412913 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-2430389b-56d6-477d-a430-87831aceb451 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:07.413688 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-2430389b-56d6-477d-a430-87831aceb451 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:07.420371 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2430389b-56d6-477d-a430-87831aceb451 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:07.421001 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2430389b-56d6-477d-a430-87831aceb451 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:07.421328 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2430389b-56d6-477d-a430-87831aceb451 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:07.422059 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2430389b-56d6-477d-a430-87831aceb451 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:07.422704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2430389b-56d6-477d-a430-87831aceb451 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:07.423131 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-2430389b-56d6-477d-a430-87831aceb451 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:07.608222 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-2430389b-56d6-477d-a430-87831aceb451 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:07.622004 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-2430389b-56d6-477d-a430-87831aceb451 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1314 microversion: 2.1 time: 0.213151 Oct 14 13:07:07.632774 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 415/835] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:07 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:07.919892 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-2de7c034-7b13-4906-8cdb-1aa0d0d07992 req-9cc2ccf3-4d43-4988-948c-4115db2061c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d015c622-b092-4144-a58e-602bb12e37b4", "name": "network-vif-plugged", "status": "completed", "tag": "ccdfe78c-36a5-4ffb-8518-874e6fcc778e"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:07:07.936581 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-2de7c034-7b13-4906-8cdb-1aa0d0d07992 req-9cc2ccf3-4d43-4988-948c-4115db2061c9 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:07.937603 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-2de7c034-7b13-4906-8cdb-1aa0d0d07992 req-9cc2ccf3-4d43-4988-948c-4115db2061c9 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:07.938478 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-2de7c034-7b13-4906-8cdb-1aa0d0d07992 req-9cc2ccf3-4d43-4988-948c-4115db2061c9 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:07.953345 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-2de7c034-7b13-4906-8cdb-1aa0d0d07992 req-9cc2ccf3-4d43-4988-948c-4115db2061c9 service nova] Creating event network-vif-plugged:ccdfe78c-36a5-4ffb-8518-874e6fcc778e for instance d015c622-b092-4144-a58e-602bb12e37b4 on hv-cinder-82099 Oct 14 13:07:07.959773 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-2de7c034-7b13-4906-8cdb-1aa0d0d07992 req-9cc2ccf3-4d43-4988-948c-4115db2061c9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046035 Oct 14 13:07:07.961911 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 421/836] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:07:08.650526 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-7c338539-d1cc-40e7-a680-0ef730bc3832 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:08.651170 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-7c338539-d1cc-40e7-a680-0ef730bc3832 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:08.657776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7c338539-d1cc-40e7-a680-0ef730bc3832 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:08.658260 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7c338539-d1cc-40e7-a680-0ef730bc3832 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:08.658756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7c338539-d1cc-40e7-a680-0ef730bc3832 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:08.659443 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7c338539-d1cc-40e7-a680-0ef730bc3832 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:08.659895 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7c338539-d1cc-40e7-a680-0ef730bc3832 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:08.660316 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-7c338539-d1cc-40e7-a680-0ef730bc3832 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:08.793157 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-7c338539-d1cc-40e7-a680-0ef730bc3832 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:08.800883 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-7c338539-d1cc-40e7-a680-0ef730bc3832 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1314 microversion: 2.1 time: 0.154190 Oct 14 13:07:08.801533 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 416/837] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:08 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:09.826531 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ee394d81-677f-4520-b168-ab02b280da00 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:09.827454 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-ee394d81-677f-4520-b168-ab02b280da00 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:09.835442 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ee394d81-677f-4520-b168-ab02b280da00 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:09.836014 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ee394d81-677f-4520-b168-ab02b280da00 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:09.836540 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ee394d81-677f-4520-b168-ab02b280da00 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:09.837333 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ee394d81-677f-4520-b168-ab02b280da00 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:09.838010 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ee394d81-677f-4520-b168-ab02b280da00 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:09.838434 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ee394d81-677f-4520-b168-ab02b280da00 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:09.987434 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ee394d81-677f-4520-b168-ab02b280da00 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:09.995405 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ee394d81-677f-4520-b168-ab02b280da00 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1498 microversion: 2.1 time: 0.175563 Oct 14 13:07:09.996281 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 422/838] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:09 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1498 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:10.403128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5bb11890-34b7-4f60-9965-e58ac5d6280f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:10.403638 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5bb11890-34b7-4f60-9965-e58ac5d6280f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:10.409910 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5bb11890-34b7-4f60-9965-e58ac5d6280f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:10.410380 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5bb11890-34b7-4f60-9965-e58ac5d6280f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:10.411299 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5bb11890-34b7-4f60-9965-e58ac5d6280f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:10.411985 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5bb11890-34b7-4f60-9965-e58ac5d6280f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:10.412433 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5bb11890-34b7-4f60-9965-e58ac5d6280f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:10.412847 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5bb11890-34b7-4f60-9965-e58ac5d6280f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:10.438325 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5bb11890-34b7-4f60-9965-e58ac5d6280f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Going to try to terminate instance {{(pid=118869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:07:10.515863 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5bb11890-34b7-4f60-9965-e58ac5d6280f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "DELETE /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 204 len: 0 microversion: 2.1 time: 0.116226 Oct 14 13:07:10.516593 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 417/839] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:07:10 2022] DELETE /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:07:10.529193 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-fffc15df-1a22-4f3c-b141-0fb0b395846d tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:10.530027 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-fffc15df-1a22-4f3c-b141-0fb0b395846d tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:10.536754 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fffc15df-1a22-4f3c-b141-0fb0b395846d tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:10.537374 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fffc15df-1a22-4f3c-b141-0fb0b395846d tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:10.537846 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fffc15df-1a22-4f3c-b141-0fb0b395846d tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:10.538552 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fffc15df-1a22-4f3c-b141-0fb0b395846d tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:10.539013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fffc15df-1a22-4f3c-b141-0fb0b395846d tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:10.539449 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fffc15df-1a22-4f3c-b141-0fb0b395846d tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:10.679095 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-fffc15df-1a22-4f3c-b141-0fb0b395846d tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:10.687096 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-fffc15df-1a22-4f3c-b141-0fb0b395846d tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1504 microversion: 2.1 time: 0.164758 Oct 14 13:07:10.687666 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 423/840] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:10 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:11.715672 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8ca66dfe-a061-4f09-9980-6fee8baf49a8 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:11.716481 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8ca66dfe-a061-4f09-9980-6fee8baf49a8 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:11.724317 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ca66dfe-a061-4f09-9980-6fee8baf49a8 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:11.724812 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ca66dfe-a061-4f09-9980-6fee8baf49a8 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:11.725320 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ca66dfe-a061-4f09-9980-6fee8baf49a8 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:11.726117 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ca66dfe-a061-4f09-9980-6fee8baf49a8 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:11.726641 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ca66dfe-a061-4f09-9980-6fee8baf49a8 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:11.727152 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ca66dfe-a061-4f09-9980-6fee8baf49a8 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:11.879365 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8ca66dfe-a061-4f09-9980-6fee8baf49a8 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:11.888222 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8ca66dfe-a061-4f09-9980-6fee8baf49a8 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1504 microversion: 2.1 time: 0.181590 Oct 14 13:07:11.893547 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 418/841] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:11 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:12.451886 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-16e54eb3-7e19-44a2-a7e1-07b806476866 req-56ff4d8b-ed6b-46f4-8606-d2463abde04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d015c622-b092-4144-a58e-602bb12e37b4", "name": "network-vif-deleted", "tag": "ccdfe78c-36a5-4ffb-8518-874e6fcc778e"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:07:12.467330 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-16e54eb3-7e19-44a2-a7e1-07b806476866 req-56ff4d8b-ed6b-46f4-8606-d2463abde04f service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:12.468215 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-16e54eb3-7e19-44a2-a7e1-07b806476866 req-56ff4d8b-ed6b-46f4-8606-d2463abde04f service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:12.481083 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-16e54eb3-7e19-44a2-a7e1-07b806476866 req-56ff4d8b-ed6b-46f4-8606-d2463abde04f service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:12.497886 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-16e54eb3-7e19-44a2-a7e1-07b806476866 req-56ff4d8b-ed6b-46f4-8606-d2463abde04f service nova] Creating event network-vif-deleted:ccdfe78c-36a5-4ffb-8518-874e6fcc778e for instance d015c622-b092-4144-a58e-602bb12e37b4 on hv-cinder-82099 Oct 14 13:07:12.507317 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-16e54eb3-7e19-44a2-a7e1-07b806476866 req-56ff4d8b-ed6b-46f4-8606-d2463abde04f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058957 Oct 14 13:07:12.508233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 424/842] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:07:12.912830 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8ff493e5-dfc6-4463-aecb-9151b86300a1 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:12.913433 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8ff493e5-dfc6-4463-aecb-9151b86300a1 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:12.916080 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:12.923615 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ff493e5-dfc6-4463-aecb-9151b86300a1 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:12.924437 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ff493e5-dfc6-4463-aecb-9151b86300a1 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:12.925033 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ff493e5-dfc6-4463-aecb-9151b86300a1 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:12.926079 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ff493e5-dfc6-4463-aecb-9151b86300a1 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:12.926737 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ff493e5-dfc6-4463-aecb-9151b86300a1 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:12.927428 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ff493e5-dfc6-4463-aecb-9151b86300a1 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:12.971102 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ff493e5-dfc6-4463-aecb-9151b86300a1 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:12.971591 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ff493e5-dfc6-4463-aecb-9151b86300a1 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:12.972024 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ff493e5-dfc6-4463-aecb-9151b86300a1 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:12.972476 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-8ff493e5-dfc6-4463-aecb-9151b86300a1 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lazy-loading 'fault' on Instance uuid d015c622-b092-4144-a58e-602bb12e37b4 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:07:13.025731 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8ff493e5-dfc6-4463-aecb-9151b86300a1 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:13.034293 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8ff493e5-dfc6-4463-aecb-9151b86300a1 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 200 len: 1304 microversion: 2.1 time: 0.126094 Oct 14 13:07:13.034916 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 419/843] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:12 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:14.060141 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7b8d1736-b4d5-4b07-9e49-97c71be27943 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:14.060866 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-7b8d1736-b4d5-4b07-9e49-97c71be27943 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: d015c622-b092-4144-a58e-602bb12e37b4] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:14.062809 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:14.068218 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7b8d1736-b4d5-4b07-9e49-97c71be27943 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:14.068707 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7b8d1736-b4d5-4b07-9e49-97c71be27943 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:14.069141 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7b8d1736-b4d5-4b07-9e49-97c71be27943 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:14.069857 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7b8d1736-b4d5-4b07-9e49-97c71be27943 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:14.070313 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7b8d1736-b4d5-4b07-9e49-97c71be27943 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:14.070740 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7b8d1736-b4d5-4b07-9e49-97c71be27943 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:14.087435 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-7b8d1736-b4d5-4b07-9e49-97c71be27943 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] HTTP exception thrown: Instance d015c622-b092-4144-a58e-602bb12e37b4 could not be found. Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7b8d1736-b4d5-4b07-9e49-97c71be27943 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Request method failure captured: Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 HTTP/1.1 Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV7rdjwSmSlH1gYwLA4hnkEfwjdkaf1QIvsp-9mLLVweQkfdt-fdrdHH3SFGSAGGLH8RRMVcdpBRsI2Jyi416cV7OAJixir0mHoRMFbcuJnNwzcCQ5I-jdhxPyY8AYm1C5D5v_VwidDaZ38eOAFQczpBLO1Bori-NPmGpgQXbCGdoac Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: ced93fb9d5dd4cbda0272ba5477b39c9 Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-VolumesActionsTest-1896059904 Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:07:14.089309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:07:14.091064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ced93fb9d5dd4cbda0272ba5477b39c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ced93fb9d5dd4cbda0272ba5477b39c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ced93fb9d5dd4cbda0272ba5477b39c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ced93fb9d5dd4cbda0272ba5477b39c9", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:07:14.091064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-VolumesActionsTest-1896059904 Oct 14 13:07:14.091064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: ced93fb9d5dd4cbda0272ba5477b39c9 Oct 14 13:07:14.091064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-VolumesActionsTest-1896059904 Oct 14 13:07:14.091064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-VolumesActionsTest-1896059904-project Oct 14 13:07:14.091064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:07:14.091064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:07:14.091064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 52ef0190e0854ed1b9b1e08224e7390d Oct 14 13:07:14.091064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-VolumesActionsTest-1896059904-project Oct 14 13:07:14.091064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:07:14.091064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance d015c622-b092-4144-a58e-602bb12e37b4 could not be found. Oct 14 13:07:14.091064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': 'd015c622-b092-4144-a58e-602bb12e37b4'} Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d015c622-b092-4144-a58e-602bb12e37b4 could not be found. Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:07:14.092039 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d015c622-b092-4144-a58e-602bb12e37b4 could not be found. Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d015c622-b092-4144-a58e-602bb12e37b4 could not be found. Oct 14 13:07:14.093999 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:07:14.095926 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7b8d1736-b4d5-4b07-9e49-97c71be27943 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Returning 404 to user: Instance d015c622-b092-4144-a58e-602bb12e37b4 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:07:14.095926 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7b8d1736-b4d5-4b07-9e49-97c71be27943 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4" status: 404 len: 111 microversion: 2.1 time: 0.035437 Oct 14 13:07:14.095926 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 425/844] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:14 2022] GET /compute/v2.1/servers/d015c622-b092-4144-a58e-602bb12e37b4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:07:14.190186 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-22107484", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "networks": [{"uuid": "4b48ab87-d6cc-4767-87d8-461a19c349f8"}]}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:07:14.247139 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.network.neutron [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] validate_networks() for [('4b48ab87-d6cc-4767-87d8-461a19c349f8', None, None, None, None, None)] {{(pid=118869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:07:14.604024 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Flavor limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:07:14.604442 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Image limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:07:14.604911 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Flavor pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:07:14.605322 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Image pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:07:14.605791 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:07:14.615228 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:14.615649 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:14.616080 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:14.616799 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:14.617245 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:14.617696 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:14.637574 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Getting quotas for project ced93fb9d5dd4cbda0272ba5477b39c9. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:07:14.641667 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Getting quotas for user 52ef0190e0854ed1b9b1e08224e7390d and project ced93fb9d5dd4cbda0272ba5477b39c9. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:07:14.653236 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Going to run 1 instances... {{(pid=118869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:07:14.655570 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:07:14.702014 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-9cc59541-26ae-46c1-b968-b79b5c1690e9 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515605 Oct 14 13:07:14.702669 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 420/845] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:07:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 13:07:14.714194 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-00f9695a-b55f-4f19-a3f3-86bfa519ced5 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:14.714808 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-00f9695a-b55f-4f19-a3f3-86bfa519ced5 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:14.772487 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-00f9695a-b55f-4f19-a3f3-86bfa519ced5 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:14.779413 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-00f9695a-b55f-4f19-a3f3-86bfa519ced5 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0" status: 200 len: 1212 microversion: 2.1 time: 0.068981 Oct 14 13:07:14.779974 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 426/846] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:14 2022] GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 => generated 1212 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:15.803985 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ab688ebc-0b7a-4f73-afcc-4e7c57f5c555 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:15.805282 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ab688ebc-0b7a-4f73-afcc-4e7c57f5c555 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:15.812101 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ab688ebc-0b7a-4f73-afcc-4e7c57f5c555 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:15.812604 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ab688ebc-0b7a-4f73-afcc-4e7c57f5c555 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:15.813031 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ab688ebc-0b7a-4f73-afcc-4e7c57f5c555 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:15.813920 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ab688ebc-0b7a-4f73-afcc-4e7c57f5c555 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:15.814381 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ab688ebc-0b7a-4f73-afcc-4e7c57f5c555 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:15.814809 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ab688ebc-0b7a-4f73-afcc-4e7c57f5c555 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:15.921993 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ab688ebc-0b7a-4f73-afcc-4e7c57f5c555 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:15.929951 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ab688ebc-0b7a-4f73-afcc-4e7c57f5c555 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0" status: 200 len: 1282 microversion: 2.1 time: 0.131110 Oct 14 13:07:15.930516 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 421/847] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:15 2022] GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 => generated 1282 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:16.953637 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-a24a7def-3860-4c4f-8a8c-fc20aa9bacf5 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:16.954257 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-a24a7def-3860-4c4f-8a8c-fc20aa9bacf5 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:16.962394 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a24a7def-3860-4c4f-8a8c-fc20aa9bacf5 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:16.962901 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a24a7def-3860-4c4f-8a8c-fc20aa9bacf5 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:16.963355 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a24a7def-3860-4c4f-8a8c-fc20aa9bacf5 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:16.964050 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a24a7def-3860-4c4f-8a8c-fc20aa9bacf5 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:16.964845 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a24a7def-3860-4c4f-8a8c-fc20aa9bacf5 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:16.965631 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a24a7def-3860-4c4f-8a8c-fc20aa9bacf5 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:17.090420 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-15321749-5a40-4024-84c6-ad3c7da67eb1 req-e94f04b5-bf0d-46de-a1ff-5ffa4a484f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c34fc60-50b1-44e9-8773-3ef79e0c8ce0", "tag": "0950f041-d94a-410a-b27d-ba8ed23f64a0"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:07:17.101600 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-15321749-5a40-4024-84c6-ad3c7da67eb1 req-e94f04b5-bf0d-46de-a1ff-5ffa4a484f39 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:17.102613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-15321749-5a40-4024-84c6-ad3c7da67eb1 req-e94f04b5-bf0d-46de-a1ff-5ffa4a484f39 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:17.103120 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-15321749-5a40-4024-84c6-ad3c7da67eb1 req-e94f04b5-bf0d-46de-a1ff-5ffa4a484f39 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:17.115907 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-15321749-5a40-4024-84c6-ad3c7da67eb1 req-e94f04b5-bf0d-46de-a1ff-5ffa4a484f39 service nova] Creating event network-changed:0950f041-d94a-410a-b27d-ba8ed23f64a0 for instance 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 on hv-cinder-82099 Oct 14 13:07:17.122307 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-15321749-5a40-4024-84c6-ad3c7da67eb1 req-e94f04b5-bf0d-46de-a1ff-5ffa4a484f39 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035870 Oct 14 13:07:17.123069 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 422/848] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:07:17.136487 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-a24a7def-3860-4c4f-8a8c-fc20aa9bacf5 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:17.144461 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-a24a7def-3860-4c4f-8a8c-fc20aa9bacf5 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0" status: 200 len: 1312 microversion: 2.1 time: 0.194713 Oct 14 13:07:17.145178 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 427/849] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:16 2022] GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 => generated 1312 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:18.169077 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0251414e-4127-494e-b3d1-e5ffff3d2ce3 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:18.169803 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-0251414e-4127-494e-b3d1-e5ffff3d2ce3 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:18.176128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0251414e-4127-494e-b3d1-e5ffff3d2ce3 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:18.177100 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0251414e-4127-494e-b3d1-e5ffff3d2ce3 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:18.177561 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0251414e-4127-494e-b3d1-e5ffff3d2ce3 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:18.178239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0251414e-4127-494e-b3d1-e5ffff3d2ce3 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:18.178689 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0251414e-4127-494e-b3d1-e5ffff3d2ce3 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:18.179108 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0251414e-4127-494e-b3d1-e5ffff3d2ce3 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:18.313090 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-0251414e-4127-494e-b3d1-e5ffff3d2ce3 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:18.321632 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-0251414e-4127-494e-b3d1-e5ffff3d2ce3 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0" status: 200 len: 1312 microversion: 2.1 time: 0.157222 Oct 14 13:07:18.322197 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 423/850] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:18 2022] GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:19.344164 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-92993efc-4352-4bdd-a8c3-98ced92d36b7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:19.344783 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-92993efc-4352-4bdd-a8c3-98ced92d36b7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:19.352090 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-92993efc-4352-4bdd-a8c3-98ced92d36b7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:19.352580 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-92993efc-4352-4bdd-a8c3-98ced92d36b7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:19.353019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-92993efc-4352-4bdd-a8c3-98ced92d36b7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:19.353770 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-92993efc-4352-4bdd-a8c3-98ced92d36b7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:19.354227 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-92993efc-4352-4bdd-a8c3-98ced92d36b7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:19.354654 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-92993efc-4352-4bdd-a8c3-98ced92d36b7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:19.484023 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-92993efc-4352-4bdd-a8c3-98ced92d36b7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:19.493037 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-92993efc-4352-4bdd-a8c3-98ced92d36b7 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0" status: 200 len: 1312 microversion: 2.1 time: 0.152668 Oct 14 13:07:19.493644 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 428/851] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:19 2022] GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:20.515978 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-817cc264-6ade-444f-89b8-2bd3157ee9cd tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:20.516544 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-817cc264-6ade-444f-89b8-2bd3157ee9cd tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:20.523637 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-817cc264-6ade-444f-89b8-2bd3157ee9cd tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:20.524111 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-817cc264-6ade-444f-89b8-2bd3157ee9cd tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:20.524538 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-817cc264-6ade-444f-89b8-2bd3157ee9cd tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:20.525215 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-817cc264-6ade-444f-89b8-2bd3157ee9cd tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:20.525697 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-817cc264-6ade-444f-89b8-2bd3157ee9cd tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:20.526115 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-817cc264-6ade-444f-89b8-2bd3157ee9cd tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:20.663766 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-817cc264-6ade-444f-89b8-2bd3157ee9cd tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:20.671519 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-817cc264-6ade-444f-89b8-2bd3157ee9cd tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0" status: 200 len: 1312 microversion: 2.1 time: 0.159620 Oct 14 13:07:20.672071 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 424/852] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:20 2022] GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:21.694713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1a4b0bd1-5c39-4a87-bf55-7d0c6d49f04b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:21.695325 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1a4b0bd1-5c39-4a87-bf55-7d0c6d49f04b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:21.701807 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1a4b0bd1-5c39-4a87-bf55-7d0c6d49f04b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:21.702297 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1a4b0bd1-5c39-4a87-bf55-7d0c6d49f04b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:21.702743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1a4b0bd1-5c39-4a87-bf55-7d0c6d49f04b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:21.703431 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1a4b0bd1-5c39-4a87-bf55-7d0c6d49f04b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:21.703888 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1a4b0bd1-5c39-4a87-bf55-7d0c6d49f04b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:21.704316 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1a4b0bd1-5c39-4a87-bf55-7d0c6d49f04b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:21.838128 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-1a4b0bd1-5c39-4a87-bf55-7d0c6d49f04b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:21.845609 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1a4b0bd1-5c39-4a87-bf55-7d0c6d49f04b tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0" status: 200 len: 1312 microversion: 2.1 time: 0.155381 Oct 14 13:07:21.846170 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 429/853] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:21 2022] GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:21.972194 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-928a26b4-416d-4e59-a4c7-7fea423cdd97 req-fc6aea9b-46e0-45fe-8201-80ffbd2fccdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c34fc60-50b1-44e9-8773-3ef79e0c8ce0", "name": "network-vif-plugged", "status": "completed", "tag": "0950f041-d94a-410a-b27d-ba8ed23f64a0"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:07:21.982717 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-928a26b4-416d-4e59-a4c7-7fea423cdd97 req-fc6aea9b-46e0-45fe-8201-80ffbd2fccdd service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:21.983328 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-928a26b4-416d-4e59-a4c7-7fea423cdd97 req-fc6aea9b-46e0-45fe-8201-80ffbd2fccdd service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:21.983755 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-928a26b4-416d-4e59-a4c7-7fea423cdd97 req-fc6aea9b-46e0-45fe-8201-80ffbd2fccdd service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:21.996648 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-928a26b4-416d-4e59-a4c7-7fea423cdd97 req-fc6aea9b-46e0-45fe-8201-80ffbd2fccdd service nova] Creating event network-vif-plugged:0950f041-d94a-410a-b27d-ba8ed23f64a0 for instance 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 on hv-cinder-82099 Oct 14 13:07:22.001274 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-928a26b4-416d-4e59-a4c7-7fea423cdd97 req-fc6aea9b-46e0-45fe-8201-80ffbd2fccdd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032787 Oct 14 13:07:22.001905 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 425/854] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:07:22.870086 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2043cdb6-e81d-4089-af49-1429a398fdfc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:22.870702 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2043cdb6-e81d-4089-af49-1429a398fdfc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:22.877071 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2043cdb6-e81d-4089-af49-1429a398fdfc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:22.877581 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2043cdb6-e81d-4089-af49-1429a398fdfc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:22.878019 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2043cdb6-e81d-4089-af49-1429a398fdfc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:22.878699 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2043cdb6-e81d-4089-af49-1429a398fdfc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:22.879152 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2043cdb6-e81d-4089-af49-1429a398fdfc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:22.879574 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2043cdb6-e81d-4089-af49-1429a398fdfc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:23.005230 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2043cdb6-e81d-4089-af49-1429a398fdfc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:23.012768 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2043cdb6-e81d-4089-af49-1429a398fdfc tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0" status: 200 len: 1312 microversion: 2.1 time: 0.146551 Oct 14 13:07:23.013318 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 430/855] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:22 2022] GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:07:24.036279 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cd0dda2f-4582-4e47-920c-dc4b3c5712d6 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:24.036984 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-cd0dda2f-4582-4e47-920c-dc4b3c5712d6 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:24.043147 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd0dda2f-4582-4e47-920c-dc4b3c5712d6 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:24.043626 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd0dda2f-4582-4e47-920c-dc4b3c5712d6 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:24.044059 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd0dda2f-4582-4e47-920c-dc4b3c5712d6 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:24.044742 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd0dda2f-4582-4e47-920c-dc4b3c5712d6 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:24.045192 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd0dda2f-4582-4e47-920c-dc4b3c5712d6 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:24.045645 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cd0dda2f-4582-4e47-920c-dc4b3c5712d6 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:24.171422 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-cd0dda2f-4582-4e47-920c-dc4b3c5712d6 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:24.179676 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-cd0dda2f-4582-4e47-920c-dc4b3c5712d6 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0" status: 200 len: 1495 microversion: 2.1 time: 0.148129 Oct 14 13:07:24.180246 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 426/856] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:24 2022] GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 => generated 1495 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:24.620475 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d4e657f9-8584-49ee-bc37-0e5f489cf360 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:24.620967 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-d4e657f9-8584-49ee-bc37-0e5f489cf360 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:24.627416 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d4e657f9-8584-49ee-bc37-0e5f489cf360 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:24.627896 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d4e657f9-8584-49ee-bc37-0e5f489cf360 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:24.628329 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d4e657f9-8584-49ee-bc37-0e5f489cf360 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:24.629038 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d4e657f9-8584-49ee-bc37-0e5f489cf360 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:24.629500 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d4e657f9-8584-49ee-bc37-0e5f489cf360 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:24.629929 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d4e657f9-8584-49ee-bc37-0e5f489cf360 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:24.632421 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:24.656374 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-d4e657f9-8584-49ee-bc37-0e5f489cf360 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] Going to try to terminate instance {{(pid=118868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:07:24.730152 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-d4e657f9-8584-49ee-bc37-0e5f489cf360 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0" status: 204 len: 0 microversion: 2.1 time: 0.113133 Oct 14 13:07:24.730729 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 431/857] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:07:24 2022] DELETE /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:07:24.739538 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0b3b5e04-db9f-4e08-8594-a890056e1e41 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:24.740142 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-0b3b5e04-db9f-4e08-8594-a890056e1e41 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:24.742379 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:24.743112 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=6 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:24.749228 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0b3b5e04-db9f-4e08-8594-a890056e1e41 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:24.749740 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0b3b5e04-db9f-4e08-8594-a890056e1e41 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:24.750173 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0b3b5e04-db9f-4e08-8594-a890056e1e41 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:24.750851 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0b3b5e04-db9f-4e08-8594-a890056e1e41 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:24.751295 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0b3b5e04-db9f-4e08-8594-a890056e1e41 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:24.751713 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0b3b5e04-db9f-4e08-8594-a890056e1e41 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:24.893713 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-0b3b5e04-db9f-4e08-8594-a890056e1e41 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:24.902336 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-0b3b5e04-db9f-4e08-8594-a890056e1e41 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0" status: 200 len: 1501 microversion: 2.1 time: 0.166384 Oct 14 13:07:24.902898 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 427/858] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:24 2022] GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:25.926561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5e24d780-5537-4461-8bb0-633412ae0742 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:25.927262 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5e24d780-5537-4461-8bb0-633412ae0742 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:25.929292 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=2 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:25.934795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e24d780-5537-4461-8bb0-633412ae0742 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:25.935285 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e24d780-5537-4461-8bb0-633412ae0742 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:25.935720 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e24d780-5537-4461-8bb0-633412ae0742 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:25.936414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e24d780-5537-4461-8bb0-633412ae0742 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:25.936866 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e24d780-5537-4461-8bb0-633412ae0742 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:25.937290 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5e24d780-5537-4461-8bb0-633412ae0742 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:26.067829 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5e24d780-5537-4461-8bb0-633412ae0742 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:26.075444 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5e24d780-5537-4461-8bb0-633412ae0742 tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0" status: 200 len: 1501 microversion: 2.1 time: 0.153281 Oct 14 13:07:26.075993 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 432/859] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:25 2022] GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:26.690778 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-4466bc25-5bae-4b2a-9809-09f81ab45dd1 req-6a7e4543-e3ab-4863-a4ce-c8644ace1943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c34fc60-50b1-44e9-8773-3ef79e0c8ce0", "name": "network-vif-deleted", "tag": "0950f041-d94a-410a-b27d-ba8ed23f64a0"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:07:26.703884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-4466bc25-5bae-4b2a-9809-09f81ab45dd1 req-6a7e4543-e3ab-4863-a4ce-c8644ace1943 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:26.704368 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-4466bc25-5bae-4b2a-9809-09f81ab45dd1 req-6a7e4543-e3ab-4863-a4ce-c8644ace1943 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:26.704804 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-4466bc25-5bae-4b2a-9809-09f81ab45dd1 req-6a7e4543-e3ab-4863-a4ce-c8644ace1943 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:26.718860 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-4466bc25-5bae-4b2a-9809-09f81ab45dd1 req-6a7e4543-e3ab-4863-a4ce-c8644ace1943 service nova] Creating event network-vif-deleted:0950f041-d94a-410a-b27d-ba8ed23f64a0 for instance 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 on hv-cinder-82099 Oct 14 13:07:26.724254 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-4466bc25-5bae-4b2a-9809-09f81ab45dd1 req-6a7e4543-e3ab-4863-a4ce-c8644ace1943 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037059 Oct 14 13:07:26.724846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 428/860] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:07:27.099327 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-dcc6ac8c-3eee-45c7-9dec-c8cd297e17ce tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:27.099939 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-dcc6ac8c-3eee-45c7-9dec-c8cd297e17ce tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:27.106354 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dcc6ac8c-3eee-45c7-9dec-c8cd297e17ce tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:27.106870 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dcc6ac8c-3eee-45c7-9dec-c8cd297e17ce tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:27.107307 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dcc6ac8c-3eee-45c7-9dec-c8cd297e17ce tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:27.107993 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dcc6ac8c-3eee-45c7-9dec-c8cd297e17ce tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:27.108446 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dcc6ac8c-3eee-45c7-9dec-c8cd297e17ce tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:27.108866 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dcc6ac8c-3eee-45c7-9dec-c8cd297e17ce tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:27.139079 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dcc6ac8c-3eee-45c7-9dec-c8cd297e17ce tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:27.139566 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dcc6ac8c-3eee-45c7-9dec-c8cd297e17ce tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:27.140001 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-dcc6ac8c-3eee-45c7-9dec-c8cd297e17ce tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:27.140448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.objects.instance [None req-dcc6ac8c-3eee-45c7-9dec-c8cd297e17ce tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lazy-loading 'fault' on Instance uuid 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 {{(pid=118868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:07:27.185859 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-dcc6ac8c-3eee-45c7-9dec-c8cd297e17ce tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52ef0190e0854ed1b9b1e08224e7390d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced93fb9d5dd4cbda0272ba5477b39c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:27.193565 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-dcc6ac8c-3eee-45c7-9dec-c8cd297e17ce tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0" status: 200 len: 1302 microversion: 2.1 time: 0.098584 Oct 14 13:07:27.194137 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 433/861] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:27 2022] GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 => generated 1302 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:28.217376 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0cff172c-22a7-4fec-8ea3-b9abdafe793f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:28.218111 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-0cff172c-22a7-4fec-8ea3-b9abdafe793f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] [instance: 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:28.224748 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0cff172c-22a7-4fec-8ea3-b9abdafe793f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:28.225226 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0cff172c-22a7-4fec-8ea3-b9abdafe793f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:28.225701 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0cff172c-22a7-4fec-8ea3-b9abdafe793f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:28.226399 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0cff172c-22a7-4fec-8ea3-b9abdafe793f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:28.226853 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0cff172c-22a7-4fec-8ea3-b9abdafe793f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:28.227280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0cff172c-22a7-4fec-8ea3-b9abdafe793f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:28.241190 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-0cff172c-22a7-4fec-8ea3-b9abdafe793f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] HTTP exception thrown: Instance 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 could not be found. Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0cff172c-22a7-4fec-8ea3-b9abdafe793f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Request method failure captured: Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 HTTP/1.1 Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV7rdjwSmSlH1gYwLA4hnkEfwjdkaf1QIvsp-9mLLVweQkfdt-fdrdHH3SFGSAGGLH8RRMVcdpBRsI2Jyi416cV7OAJixir0mHoRMFbcuJnNwzcCQ5I-jdhxPyY8AYm1C5D5v_VwidDaZ38eOAFQczpBLO1Bori-NPmGpgQXbCGdoac Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: ced93fb9d5dd4cbda0272ba5477b39c9 Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-VolumesActionsTest-1896059904 Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:07:28.242822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:07:28.244479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ced93fb9d5dd4cbda0272ba5477b39c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ced93fb9d5dd4cbda0272ba5477b39c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ced93fb9d5dd4cbda0272ba5477b39c9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ced93fb9d5dd4cbda0272ba5477b39c9", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:07:28.244479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-VolumesActionsTest-1896059904 Oct 14 13:07:28.244479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: ced93fb9d5dd4cbda0272ba5477b39c9 Oct 14 13:07:28.244479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-VolumesActionsTest-1896059904 Oct 14 13:07:28.244479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-VolumesActionsTest-1896059904-project Oct 14 13:07:28.244479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:07:28.244479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:07:28.244479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 52ef0190e0854ed1b9b1e08224e7390d Oct 14 13:07:28.244479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-VolumesActionsTest-1896059904-project Oct 14 13:07:28.244479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:07:28.244479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 could not be found. Oct 14 13:07:28.244479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '8c34fc60-50b1-44e9-8773-3ef79e0c8ce0'} Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 could not be found. Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:07:28.245411 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 could not be found. Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 could not be found. Oct 14 13:07:28.247148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:07:28.248523 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0cff172c-22a7-4fec-8ea3-b9abdafe793f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] Returning 404 to user: Instance 8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:07:28.248523 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-0cff172c-22a7-4fec-8ea3-b9abdafe793f tempest-VolumesActionsTest-1896059904 tempest-VolumesActionsTest-1896059904-project] 10.222.0.47 "GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0" status: 404 len: 111 microversion: 2.1 time: 0.031498 Oct 14 13:07:28.248523 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 429/862] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:28 2022] GET /compute/v2.1/servers/8c34fc60-50b1-44e9-8773-3ef79e0c8ce0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:07:29.540030 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2d3a669d-cc4e-415b-a718-8e9eee6e42bd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:07:29.542172 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2d3a669d-cc4e-415b-a718-8e9eee6e42bd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:29.548859 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d3a669d-cc4e-415b-a718-8e9eee6e42bd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:29.549381 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d3a669d-cc4e-415b-a718-8e9eee6e42bd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:29.549853 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d3a669d-cc4e-415b-a718-8e9eee6e42bd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:29.550579 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d3a669d-cc4e-415b-a718-8e9eee6e42bd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:29.551028 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d3a669d-cc4e-415b-a718-8e9eee6e42bd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:29.551478 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2d3a669d-cc4e-415b-a718-8e9eee6e42bd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:29.621336 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2d3a669d-cc4e-415b-a718-8e9eee6e42bd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "POST /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/action" status: 202 len: 0 microversion: 2.1 time: 0.085722 Oct 14 13:07:29.622224 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 434/863] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Oct 14 13:07:29 2022] POST /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:07:29.630487 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-528bdcff-c968-4b9a-8ba5-3f2fda778838 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:29.631640 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-528bdcff-c968-4b9a-8ba5-3f2fda778838 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:29.638526 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-528bdcff-c968-4b9a-8ba5-3f2fda778838 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:29.639023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-528bdcff-c968-4b9a-8ba5-3f2fda778838 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:29.639659 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-528bdcff-c968-4b9a-8ba5-3f2fda778838 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:29.640417 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-528bdcff-c968-4b9a-8ba5-3f2fda778838 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:29.640912 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-528bdcff-c968-4b9a-8ba5-3f2fda778838 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:29.641339 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-528bdcff-c968-4b9a-8ba5-3f2fda778838 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:29.788640 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-528bdcff-c968-4b9a-8ba5-3f2fda778838 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:29.796884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-528bdcff-c968-4b9a-8ba5-3f2fda778838 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1750 microversion: 2.1 time: 0.170708 Oct 14 13:07:29.797368 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 430/864] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:29 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1750 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:30.820670 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f5754e96-f3bd-4a41-a72c-b09e3cd8ceb1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:30.821370 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-f5754e96-f3bd-4a41-a72c-b09e3cd8ceb1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:30.827450 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5754e96-f3bd-4a41-a72c-b09e3cd8ceb1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:30.827925 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5754e96-f3bd-4a41-a72c-b09e3cd8ceb1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:30.828358 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5754e96-f3bd-4a41-a72c-b09e3cd8ceb1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:30.829040 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5754e96-f3bd-4a41-a72c-b09e3cd8ceb1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:30.829499 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5754e96-f3bd-4a41-a72c-b09e3cd8ceb1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:30.829932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f5754e96-f3bd-4a41-a72c-b09e3cd8ceb1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:30.969758 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f5754e96-f3bd-4a41-a72c-b09e3cd8ceb1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:30.978680 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f5754e96-f3bd-4a41-a72c-b09e3cd8ceb1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1750 microversion: 2.1 time: 0.162683 Oct 14 13:07:30.979487 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 435/865] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:30 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:32.002076 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-afde8241-679f-43ba-8e04-a5d6d7cd1851 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:32.002693 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-afde8241-679f-43ba-8e04-a5d6d7cd1851 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:32.009644 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-afde8241-679f-43ba-8e04-a5d6d7cd1851 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:32.010125 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-afde8241-679f-43ba-8e04-a5d6d7cd1851 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:32.010557 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-afde8241-679f-43ba-8e04-a5d6d7cd1851 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:32.011243 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-afde8241-679f-43ba-8e04-a5d6d7cd1851 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:32.011809 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-afde8241-679f-43ba-8e04-a5d6d7cd1851 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:32.012093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-afde8241-679f-43ba-8e04-a5d6d7cd1851 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:32.203873 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-afde8241-679f-43ba-8e04-a5d6d7cd1851 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:32.212696 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-afde8241-679f-43ba-8e04-a5d6d7cd1851 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1750 microversion: 2.1 time: 0.214459 Oct 14 13:07:32.213243 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 431/866] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:31 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1750 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:33.235768 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7dfc71bf-e2fa-4eab-9723-72bda0dcf1dd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:33.236315 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-7dfc71bf-e2fa-4eab-9723-72bda0dcf1dd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:33.242960 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7dfc71bf-e2fa-4eab-9723-72bda0dcf1dd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:33.243462 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7dfc71bf-e2fa-4eab-9723-72bda0dcf1dd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:33.243874 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7dfc71bf-e2fa-4eab-9723-72bda0dcf1dd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:33.244558 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7dfc71bf-e2fa-4eab-9723-72bda0dcf1dd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:33.245007 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7dfc71bf-e2fa-4eab-9723-72bda0dcf1dd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:33.245427 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7dfc71bf-e2fa-4eab-9723-72bda0dcf1dd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:33.384359 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-7dfc71bf-e2fa-4eab-9723-72bda0dcf1dd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:33.392960 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7dfc71bf-e2fa-4eab-9723-72bda0dcf1dd tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1750 microversion: 2.1 time: 0.161185 Oct 14 13:07:33.393532 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 436/867] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:33 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:34.417145 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-25417a50-3b94-443d-8b8f-3064b6cdce0b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:34.417778 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-25417a50-3b94-443d-8b8f-3064b6cdce0b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:34.424183 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-25417a50-3b94-443d-8b8f-3064b6cdce0b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:34.424655 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-25417a50-3b94-443d-8b8f-3064b6cdce0b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:34.425079 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-25417a50-3b94-443d-8b8f-3064b6cdce0b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:34.426441 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-25417a50-3b94-443d-8b8f-3064b6cdce0b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:34.426883 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-25417a50-3b94-443d-8b8f-3064b6cdce0b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:34.427296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-25417a50-3b94-443d-8b8f-3064b6cdce0b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:34.441952 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:34.568892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-25417a50-3b94-443d-8b8f-3064b6cdce0b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:34.577131 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-25417a50-3b94-443d-8b8f-3064b6cdce0b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1750 microversion: 2.1 time: 0.163784 Oct 14 13:07:34.577919 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 432/868] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:34 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:35.601183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2f9b19fb-ba09-48a2-9dca-2858dc7c3d0a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:35.603179 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2f9b19fb-ba09-48a2-9dca-2858dc7c3d0a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:35.611888 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f9b19fb-ba09-48a2-9dca-2858dc7c3d0a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:35.612215 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f9b19fb-ba09-48a2-9dca-2858dc7c3d0a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:35.614167 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f9b19fb-ba09-48a2-9dca-2858dc7c3d0a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:35.614311 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f9b19fb-ba09-48a2-9dca-2858dc7c3d0a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:35.614753 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f9b19fb-ba09-48a2-9dca-2858dc7c3d0a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:35.615117 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f9b19fb-ba09-48a2-9dca-2858dc7c3d0a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:35.770525 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2f9b19fb-ba09-48a2-9dca-2858dc7c3d0a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:35.778893 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2f9b19fb-ba09-48a2-9dca-2858dc7c3d0a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1755 microversion: 2.1 time: 0.182276 Oct 14 13:07:35.784507 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 437/869] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:35 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:36.814766 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-fe5adfc6-fe51-4b3c-bc4c-e5a453d6139a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:36.816159 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-fe5adfc6-fe51-4b3c-bc4c-e5a453d6139a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:36.824928 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fe5adfc6-fe51-4b3c-bc4c-e5a453d6139a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:36.825818 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fe5adfc6-fe51-4b3c-bc4c-e5a453d6139a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:36.826734 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fe5adfc6-fe51-4b3c-bc4c-e5a453d6139a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:36.827842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fe5adfc6-fe51-4b3c-bc4c-e5a453d6139a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:36.828686 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fe5adfc6-fe51-4b3c-bc4c-e5a453d6139a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:36.829328 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fe5adfc6-fe51-4b3c-bc4c-e5a453d6139a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:37.006239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-fe5adfc6-fe51-4b3c-bc4c-e5a453d6139a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:37.015465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-fe5adfc6-fe51-4b3c-bc4c-e5a453d6139a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1755 microversion: 2.1 time: 0.204821 Oct 14 13:07:37.017520 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 433/870] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:36 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:38.043324 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-85a3d484-815c-407c-b408-62e0bda07323 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:38.044985 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-85a3d484-815c-407c-b408-62e0bda07323 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:38.053838 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-85a3d484-815c-407c-b408-62e0bda07323 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:38.054785 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-85a3d484-815c-407c-b408-62e0bda07323 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:38.055993 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-85a3d484-815c-407c-b408-62e0bda07323 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:38.057146 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-85a3d484-815c-407c-b408-62e0bda07323 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:38.058275 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-85a3d484-815c-407c-b408-62e0bda07323 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:38.059013 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-85a3d484-815c-407c-b408-62e0bda07323 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:38.250725 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-85a3d484-815c-407c-b408-62e0bda07323 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:38.260439 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-85a3d484-815c-407c-b408-62e0bda07323 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1755 microversion: 2.1 time: 0.224261 Oct 14 13:07:38.261038 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 438/871] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:38 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1755 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:39.290835 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-1645e9b9-032f-4da2-a4a7-a834cb7e1c72 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:39.292379 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-1645e9b9-032f-4da2-a4a7-a834cb7e1c72 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:39.301318 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1645e9b9-032f-4da2-a4a7-a834cb7e1c72 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:39.302039 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1645e9b9-032f-4da2-a4a7-a834cb7e1c72 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:39.303583 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1645e9b9-032f-4da2-a4a7-a834cb7e1c72 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:39.304550 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1645e9b9-032f-4da2-a4a7-a834cb7e1c72 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:39.305443 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1645e9b9-032f-4da2-a4a7-a834cb7e1c72 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:39.306110 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1645e9b9-032f-4da2-a4a7-a834cb7e1c72 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:39.491915 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-1645e9b9-032f-4da2-a4a7-a834cb7e1c72 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:39.506021 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-1645e9b9-032f-4da2-a4a7-a834cb7e1c72 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1755 microversion: 2.1 time: 0.219839 Oct 14 13:07:39.507339 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 434/872] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:39 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1755 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:40.536831 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0d69c5d8-32e7-4aa3-a4fb-36cb5cafe8e4 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:40.538201 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0d69c5d8-32e7-4aa3-a4fb-36cb5cafe8e4 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:40.554484 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d69c5d8-32e7-4aa3-a4fb-36cb5cafe8e4 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:40.555721 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d69c5d8-32e7-4aa3-a4fb-36cb5cafe8e4 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:40.556842 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d69c5d8-32e7-4aa3-a4fb-36cb5cafe8e4 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:40.558131 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d69c5d8-32e7-4aa3-a4fb-36cb5cafe8e4 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:40.562952 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d69c5d8-32e7-4aa3-a4fb-36cb5cafe8e4 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:40.564868 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0d69c5d8-32e7-4aa3-a4fb-36cb5cafe8e4 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:40.803592 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0d69c5d8-32e7-4aa3-a4fb-36cb5cafe8e4 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:40.813689 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0d69c5d8-32e7-4aa3-a4fb-36cb5cafe8e4 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1755 microversion: 2.1 time: 0.281796 Oct 14 13:07:40.830361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 439/873] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:40 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1755 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:41.844124 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4cc803b0-4a58-4822-92bf-8b57bcf8eb19 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:41.844124 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4cc803b0-4a58-4822-92bf-8b57bcf8eb19 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:41.853287 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cc803b0-4a58-4822-92bf-8b57bcf8eb19 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:41.854024 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cc803b0-4a58-4822-92bf-8b57bcf8eb19 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:41.854655 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cc803b0-4a58-4822-92bf-8b57bcf8eb19 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:41.855360 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cc803b0-4a58-4822-92bf-8b57bcf8eb19 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:41.855810 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cc803b0-4a58-4822-92bf-8b57bcf8eb19 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:41.856407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4cc803b0-4a58-4822-92bf-8b57bcf8eb19 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:42.055920 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4cc803b0-4a58-4822-92bf-8b57bcf8eb19 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:42.065000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4cc803b0-4a58-4822-92bf-8b57bcf8eb19 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1755 microversion: 2.1 time: 0.225226 Oct 14 13:07:42.065605 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 435/874] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:41 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1755 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:43.096152 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2ae49a35-8658-4c54-a84d-f55b64afe6e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:43.106467 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2ae49a35-8658-4c54-a84d-f55b64afe6e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:43.119003 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ae49a35-8658-4c54-a84d-f55b64afe6e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:43.125570 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ae49a35-8658-4c54-a84d-f55b64afe6e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:43.126275 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ae49a35-8658-4c54-a84d-f55b64afe6e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:43.127279 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ae49a35-8658-4c54-a84d-f55b64afe6e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:43.134113 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ae49a35-8658-4c54-a84d-f55b64afe6e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:43.134481 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2ae49a35-8658-4c54-a84d-f55b64afe6e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:43.338478 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2ae49a35-8658-4c54-a84d-f55b64afe6e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:43.348760 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2ae49a35-8658-4c54-a84d-f55b64afe6e0 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1755 microversion: 2.1 time: 0.264368 Oct 14 13:07:43.361509 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 440/875] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:43 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1755 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:44.386258 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c0210057-76e2-4768-9227-5863b1f86ecb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:44.386955 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c0210057-76e2-4768-9227-5863b1f86ecb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:44.398172 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:44.400429 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c0210057-76e2-4768-9227-5863b1f86ecb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:44.401410 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c0210057-76e2-4768-9227-5863b1f86ecb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:44.402120 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c0210057-76e2-4768-9227-5863b1f86ecb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:44.403963 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c0210057-76e2-4768-9227-5863b1f86ecb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:44.404662 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c0210057-76e2-4768-9227-5863b1f86ecb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:44.405299 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c0210057-76e2-4768-9227-5863b1f86ecb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:44.608662 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c0210057-76e2-4768-9227-5863b1f86ecb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:44.618219 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c0210057-76e2-4768-9227-5863b1f86ecb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1755 microversion: 2.1 time: 0.246704 Oct 14 13:07:44.618916 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 436/876] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:44 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1755 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:45.642655 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e9d7b8fe-9275-404b-a603-eb1df13b93bb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:45.643608 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e9d7b8fe-9275-404b-a603-eb1df13b93bb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:45.649373 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:45.658157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e9d7b8fe-9275-404b-a603-eb1df13b93bb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:45.658660 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e9d7b8fe-9275-404b-a603-eb1df13b93bb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:45.659101 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e9d7b8fe-9275-404b-a603-eb1df13b93bb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:45.659889 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e9d7b8fe-9275-404b-a603-eb1df13b93bb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:45.660346 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e9d7b8fe-9275-404b-a603-eb1df13b93bb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:45.660773 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e9d7b8fe-9275-404b-a603-eb1df13b93bb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:45.851128 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e9d7b8fe-9275-404b-a603-eb1df13b93bb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:45.862281 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e9d7b8fe-9275-404b-a603-eb1df13b93bb tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1755 microversion: 2.1 time: 0.223472 Oct 14 13:07:45.863319 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 441/877] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:45 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1755 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:46.888567 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-fc1981b5-ce60-4520-9237-3cdf45f7606f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:46.889401 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-fc1981b5-ce60-4520-9237-3cdf45f7606f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:46.899049 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc1981b5-ce60-4520-9237-3cdf45f7606f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:46.899632 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc1981b5-ce60-4520-9237-3cdf45f7606f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:46.900407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc1981b5-ce60-4520-9237-3cdf45f7606f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:46.901130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc1981b5-ce60-4520-9237-3cdf45f7606f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:46.901616 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc1981b5-ce60-4520-9237-3cdf45f7606f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:46.902684 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc1981b5-ce60-4520-9237-3cdf45f7606f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:47.073351 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-fc1981b5-ce60-4520-9237-3cdf45f7606f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:47.082916 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-fc1981b5-ce60-4520-9237-3cdf45f7606f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1755 microversion: 2.1 time: 0.198690 Oct 14 13:07:47.083801 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 437/878] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:46 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:48.106531 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2358f80e-48de-4d5b-b573-2d54ebc427b1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:48.107831 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2358f80e-48de-4d5b-b573-2d54ebc427b1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:48.114550 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2358f80e-48de-4d5b-b573-2d54ebc427b1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:48.115310 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2358f80e-48de-4d5b-b573-2d54ebc427b1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:48.116128 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2358f80e-48de-4d5b-b573-2d54ebc427b1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:48.117423 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2358f80e-48de-4d5b-b573-2d54ebc427b1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:48.118222 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2358f80e-48de-4d5b-b573-2d54ebc427b1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:48.119131 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2358f80e-48de-4d5b-b573-2d54ebc427b1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:48.354379 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2358f80e-48de-4d5b-b573-2d54ebc427b1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:48.368352 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2358f80e-48de-4d5b-b573-2d54ebc427b1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1755 microversion: 2.1 time: 0.265274 Oct 14 13:07:48.369200 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 442/879] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:48 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1755 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:49.404928 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-b8312d5f-b143-43d8-9e80-d250a4aa0b4f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:49.406238 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-b8312d5f-b143-43d8-9e80-d250a4aa0b4f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:49.414318 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b8312d5f-b143-43d8-9e80-d250a4aa0b4f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:49.415326 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b8312d5f-b143-43d8-9e80-d250a4aa0b4f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:49.415991 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b8312d5f-b143-43d8-9e80-d250a4aa0b4f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:49.416943 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b8312d5f-b143-43d8-9e80-d250a4aa0b4f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:49.417633 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b8312d5f-b143-43d8-9e80-d250a4aa0b4f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:49.418274 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b8312d5f-b143-43d8-9e80-d250a4aa0b4f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:49.590907 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-b8312d5f-b143-43d8-9e80-d250a4aa0b4f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:49.602256 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-b8312d5f-b143-43d8-9e80-d250a4aa0b4f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1755 microversion: 2.1 time: 0.202904 Oct 14 13:07:49.603040 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 438/880] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:49 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1755 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:50.626866 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5f511cc3-f2b3-410f-8125-8367080871c6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:50.628148 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5f511cc3-f2b3-410f-8125-8367080871c6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:50.634929 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5f511cc3-f2b3-410f-8125-8367080871c6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:50.635808 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5f511cc3-f2b3-410f-8125-8367080871c6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:50.636665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5f511cc3-f2b3-410f-8125-8367080871c6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:50.637701 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5f511cc3-f2b3-410f-8125-8367080871c6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:50.638592 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5f511cc3-f2b3-410f-8125-8367080871c6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:50.639675 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5f511cc3-f2b3-410f-8125-8367080871c6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:50.810895 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5f511cc3-f2b3-410f-8125-8367080871c6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:50.819989 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5f511cc3-f2b3-410f-8125-8367080871c6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1755 microversion: 2.1 time: 0.197720 Oct 14 13:07:50.820752 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 443/881] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:50 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1755 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:51.843129 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-49425168-4c51-421e-ab8d-e82a3941f790 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:51.843885 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-49425168-4c51-421e-ab8d-e82a3941f790 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:51.850369 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-49425168-4c51-421e-ab8d-e82a3941f790 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:51.850848 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-49425168-4c51-421e-ab8d-e82a3941f790 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:51.851278 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-49425168-4c51-421e-ab8d-e82a3941f790 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:51.851966 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-49425168-4c51-421e-ab8d-e82a3941f790 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:51.852421 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-49425168-4c51-421e-ab8d-e82a3941f790 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:51.852839 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-49425168-4c51-421e-ab8d-e82a3941f790 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:51.992668 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-49425168-4c51-421e-ab8d-e82a3941f790 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:52.000777 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-49425168-4c51-421e-ab8d-e82a3941f790 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1755 microversion: 2.1 time: 0.161692 Oct 14 13:07:52.001333 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 439/882] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:51 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:53.024634 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9d5d8b02-0f3a-409e-abc8-35c0c57ce1a6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:53.025249 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-9d5d8b02-0f3a-409e-abc8-35c0c57ce1a6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:53.031660 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9d5d8b02-0f3a-409e-abc8-35c0c57ce1a6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:53.032147 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9d5d8b02-0f3a-409e-abc8-35c0c57ce1a6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:53.032582 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9d5d8b02-0f3a-409e-abc8-35c0c57ce1a6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:53.033280 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9d5d8b02-0f3a-409e-abc8-35c0c57ce1a6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:53.033788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9d5d8b02-0f3a-409e-abc8-35c0c57ce1a6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:53.034478 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9d5d8b02-0f3a-409e-abc8-35c0c57ce1a6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:53.174340 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9d5d8b02-0f3a-409e-abc8-35c0c57ce1a6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:53.176525 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:07:53.184470 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-9d5d8b02-0f3a-409e-abc8-35c0c57ce1a6 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1755 microversion: 2.1 time: 0.164255 Oct 14 13:07:53.185031 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 444/883] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:53 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:54.208793 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-52cc9aa9-5e4c-4557-b9a2-483d20301ce1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:07:54.209399 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-52cc9aa9-5e4c-4557-b9a2-483d20301ce1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:07:54.216963 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-52cc9aa9-5e4c-4557-b9a2-483d20301ce1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:54.217442 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-52cc9aa9-5e4c-4557-b9a2-483d20301ce1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:54.217896 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-52cc9aa9-5e4c-4557-b9a2-483d20301ce1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:54.218575 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-52cc9aa9-5e4c-4557-b9a2-483d20301ce1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:54.219023 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-52cc9aa9-5e4c-4557-b9a2-483d20301ce1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:54.219527 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-52cc9aa9-5e4c-4557-b9a2-483d20301ce1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:54.392076 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-52cc9aa9-5e4c-4557-b9a2-483d20301ce1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:07:54.401753 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-52cc9aa9-5e4c-4557-b9a2-483d20301ce1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1758 microversion: 2.1 time: 0.197459 Oct 14 13:07:54.402314 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 440/884] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:07:54 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1758 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:07:59.272273 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1645908997", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "networks": [{"uuid": "1c2660e1-be1e-4e0b-875b-b00cf5d04c16"}]}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:07:59.326511 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.network.neutron [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] validate_networks() for [('1c2660e1-be1e-4e0b-875b-b00cf5d04c16', None, None, None, None, None)] {{(pid=118868) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:07:59.749969 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Flavor limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:07:59.750385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Image limits 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:07:59.750851 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Flavor pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:07:59.751252 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Image pref 0:0:0 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:07:59.751657 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.virt.hardware [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118868) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:07:59.762124 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:59.762603 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:59.763037 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:59.763750 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:07:59.764203 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:07:59.764624 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:07:59.782218 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Getting quotas for project bec5bb9b1b73416fb97534f476f2dce2. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:07:59.786297 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Getting quotas for user 72c8077c28fa40a99c090dc6b11a769b and project bec5bb9b1b73416fb97534f476f2dce2. Resources: {'instances', 'ram', 'cores'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:07:59.797399 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Going to run 1 instances... {{(pid=118868) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:07:59.799932 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118868) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:07:59.845215 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR oslo.messaging._drivers.impl_rabbit [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [a1a88ada-aa10-4fd1-83ea-4cf4d146a436] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 14 13:08:00.854457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO oslo.messaging._drivers.impl_rabbit [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [a1a88ada-aa10-4fd1-83ea-4cf4d146a436] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 51818. Oct 14 13:08:00.858430 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-175a0cc1-197a-4397-8057-314076ea6faa tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.590624 Oct 14 13:08:00.859085 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 445/885] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:07:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 13:08:00.870348 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-23b10a35-93c7-401b-b613-9cb4f9072e2a tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:00.871131 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-23b10a35-93c7-401b-b613-9cb4f9072e2a tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:00.926028 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-23b10a35-93c7-401b-b613-9cb4f9072e2a tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:00.934651 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-23b10a35-93c7-401b-b613-9cb4f9072e2a tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70" status: 200 len: 1219 microversion: 2.1 time: 0.067118 Oct 14 13:08:00.935439 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 441/886] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:00 2022] GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:01.958116 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9daef62e-c00d-4536-bf66-138f88113404 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:01.959447 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-9daef62e-c00d-4536-bf66-138f88113404 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:01.966600 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9daef62e-c00d-4536-bf66-138f88113404 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:01.967098 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9daef62e-c00d-4536-bf66-138f88113404 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:01.967577 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9daef62e-c00d-4536-bf66-138f88113404 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:01.968294 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9daef62e-c00d-4536-bf66-138f88113404 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:01.968751 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9daef62e-c00d-4536-bf66-138f88113404 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:01.969183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9daef62e-c00d-4536-bf66-138f88113404 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:02.031992 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9daef62e-c00d-4536-bf66-138f88113404 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:02.039663 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-9daef62e-c00d-4536-bf66-138f88113404 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70" status: 200 len: 1271 microversion: 2.1 time: 0.086133 Oct 14 13:08:02.040283 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 446/887] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:01 2022] GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:03.062468 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-1694f19d-f81c-49a9-963f-8cd5514efd8a tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:03.063022 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-1694f19d-f81c-49a9-963f-8cd5514efd8a tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:03.071216 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1694f19d-f81c-49a9-963f-8cd5514efd8a tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:03.071769 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1694f19d-f81c-49a9-963f-8cd5514efd8a tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:03.072214 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1694f19d-f81c-49a9-963f-8cd5514efd8a tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:03.073141 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1694f19d-f81c-49a9-963f-8cd5514efd8a tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:03.073628 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1694f19d-f81c-49a9-963f-8cd5514efd8a tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:03.074059 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1694f19d-f81c-49a9-963f-8cd5514efd8a tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:03.280324 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-1694f19d-f81c-49a9-963f-8cd5514efd8a tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:03.288736 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-1694f19d-f81c-49a9-963f-8cd5514efd8a tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70" status: 200 len: 1319 microversion: 2.1 time: 0.230362 Oct 14 13:08:03.289644 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 442/888] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:03 2022] GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:03.603798 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-70df1d26-955b-464e-9daf-06dcd65339db req-64c0cd4c-280b-4c90-912f-422724b207f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70", "tag": "99637d80-6745-4a09-a224-f4310e8b4982"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:08:03.620216 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-70df1d26-955b-464e-9daf-06dcd65339db req-64c0cd4c-280b-4c90-912f-422724b207f3 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:03.620749 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-70df1d26-955b-464e-9daf-06dcd65339db req-64c0cd4c-280b-4c90-912f-422724b207f3 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:03.621249 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-70df1d26-955b-464e-9daf-06dcd65339db req-64c0cd4c-280b-4c90-912f-422724b207f3 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:03.637017 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-70df1d26-955b-464e-9daf-06dcd65339db req-64c0cd4c-280b-4c90-912f-422724b207f3 service nova] Creating event network-changed:99637d80-6745-4a09-a224-f4310e8b4982 for instance fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 on hv-cinder-82099 Oct 14 13:08:03.642339 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-70df1d26-955b-464e-9daf-06dcd65339db req-64c0cd4c-280b-4c90-912f-422724b207f3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044327 Oct 14 13:08:03.643321 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 447/889] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:08:04.313388 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-af16c485-94cc-4ccd-a7ee-a46ca5771435 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:04.314098 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-af16c485-94cc-4ccd-a7ee-a46ca5771435 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:04.320612 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af16c485-94cc-4ccd-a7ee-a46ca5771435 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:04.321191 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af16c485-94cc-4ccd-a7ee-a46ca5771435 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:04.321694 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af16c485-94cc-4ccd-a7ee-a46ca5771435 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:04.322425 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af16c485-94cc-4ccd-a7ee-a46ca5771435 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:04.322882 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af16c485-94cc-4ccd-a7ee-a46ca5771435 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:04.323324 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-af16c485-94cc-4ccd-a7ee-a46ca5771435 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:04.460277 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-af16c485-94cc-4ccd-a7ee-a46ca5771435 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:04.462493 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=62 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:04.468835 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-af16c485-94cc-4ccd-a7ee-a46ca5771435 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70" status: 200 len: 1319 microversion: 2.1 time: 0.159248 Oct 14 13:08:04.469399 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 443/890] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:04 2022] GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:05.492581 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ffb854a7-4335-4dff-9790-67f0d7dce65f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:05.493218 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-ffb854a7-4335-4dff-9790-67f0d7dce65f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:05.499759 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ffb854a7-4335-4dff-9790-67f0d7dce65f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:05.500253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ffb854a7-4335-4dff-9790-67f0d7dce65f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:05.500693 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ffb854a7-4335-4dff-9790-67f0d7dce65f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:05.501408 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ffb854a7-4335-4dff-9790-67f0d7dce65f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:05.501909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ffb854a7-4335-4dff-9790-67f0d7dce65f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:05.502346 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ffb854a7-4335-4dff-9790-67f0d7dce65f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:05.636220 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ffb854a7-4335-4dff-9790-67f0d7dce65f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:05.644611 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ffb854a7-4335-4dff-9790-67f0d7dce65f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70" status: 200 len: 1319 microversion: 2.1 time: 0.156774 Oct 14 13:08:05.645179 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 448/891] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:05 2022] GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:06.669237 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e4643d36-c8b2-4fd1-a436-41280026ab87 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:06.669817 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e4643d36-c8b2-4fd1-a436-41280026ab87 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:06.678991 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e4643d36-c8b2-4fd1-a436-41280026ab87 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:06.679693 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e4643d36-c8b2-4fd1-a436-41280026ab87 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:06.680218 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e4643d36-c8b2-4fd1-a436-41280026ab87 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:06.680932 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e4643d36-c8b2-4fd1-a436-41280026ab87 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:06.681388 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e4643d36-c8b2-4fd1-a436-41280026ab87 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:06.681856 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e4643d36-c8b2-4fd1-a436-41280026ab87 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:06.823315 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e4643d36-c8b2-4fd1-a436-41280026ab87 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:06.831880 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e4643d36-c8b2-4fd1-a436-41280026ab87 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70" status: 200 len: 1319 microversion: 2.1 time: 0.167248 Oct 14 13:08:06.832712 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 444/892] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:06 2022] GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:07.855944 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-8c963205-4f7f-4b85-bf37-31078838fe03 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:07.856597 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-8c963205-4f7f-4b85-bf37-31078838fe03 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:07.863396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8c963205-4f7f-4b85-bf37-31078838fe03 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:07.863885 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8c963205-4f7f-4b85-bf37-31078838fe03 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:07.864322 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8c963205-4f7f-4b85-bf37-31078838fe03 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:07.865750 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8c963205-4f7f-4b85-bf37-31078838fe03 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:07.866094 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8c963205-4f7f-4b85-bf37-31078838fe03 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:07.866525 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-8c963205-4f7f-4b85-bf37-31078838fe03 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:08.002815 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-8c963205-4f7f-4b85-bf37-31078838fe03 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:08.010607 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-8c963205-4f7f-4b85-bf37-31078838fe03 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70" status: 200 len: 1319 microversion: 2.1 time: 0.158550 Oct 14 13:08:08.011162 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 449/893] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:07 2022] GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:08:08.192622 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-f2175d25-4ec2-4098-8cf8-3ded35a3c7db req-fbd65a89-005f-4804-896e-eb394ea33756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70", "name": "network-vif-plugged", "status": "completed", "tag": "99637d80-6745-4a09-a224-f4310e8b4982"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:08:08.203596 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-f2175d25-4ec2-4098-8cf8-3ded35a3c7db req-fbd65a89-005f-4804-896e-eb394ea33756 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:08.204441 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-f2175d25-4ec2-4098-8cf8-3ded35a3c7db req-fbd65a89-005f-4804-896e-eb394ea33756 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:08.204871 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-f2175d25-4ec2-4098-8cf8-3ded35a3c7db req-fbd65a89-005f-4804-896e-eb394ea33756 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:08.218064 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-f2175d25-4ec2-4098-8cf8-3ded35a3c7db req-fbd65a89-005f-4804-896e-eb394ea33756 service nova] Creating event network-vif-plugged:99637d80-6745-4a09-a224-f4310e8b4982 for instance fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 on hv-cinder-82099 Oct 14 13:08:08.223020 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-f2175d25-4ec2-4098-8cf8-3ded35a3c7db req-fbd65a89-005f-4804-896e-eb394ea33756 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034115 Oct 14 13:08:08.223618 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 445/894] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:08:09.032414 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-a15022e5-f97f-429e-b919-68c3aa8b3a80 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:09.033021 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-a15022e5-f97f-429e-b919-68c3aa8b3a80 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:09.040009 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a15022e5-f97f-429e-b919-68c3aa8b3a80 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:09.040504 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a15022e5-f97f-429e-b919-68c3aa8b3a80 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:09.040919 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a15022e5-f97f-429e-b919-68c3aa8b3a80 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:09.041625 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a15022e5-f97f-429e-b919-68c3aa8b3a80 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:09.042073 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a15022e5-f97f-429e-b919-68c3aa8b3a80 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:09.042494 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-a15022e5-f97f-429e-b919-68c3aa8b3a80 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:09.169945 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-a15022e5-f97f-429e-b919-68c3aa8b3a80 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:09.177514 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-a15022e5-f97f-429e-b919-68c3aa8b3a80 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70" status: 200 len: 1319 microversion: 2.1 time: 0.149070 Oct 14 13:08:09.178074 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 450/895] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:09 2022] GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:10.201168 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cf5858c7-8c6f-4377-9d8b-d1e99b43012d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:10.201824 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-cf5858c7-8c6f-4377-9d8b-d1e99b43012d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:10.208449 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf5858c7-8c6f-4377-9d8b-d1e99b43012d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:10.208930 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf5858c7-8c6f-4377-9d8b-d1e99b43012d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:10.209362 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf5858c7-8c6f-4377-9d8b-d1e99b43012d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:10.210131 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf5858c7-8c6f-4377-9d8b-d1e99b43012d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:10.210586 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf5858c7-8c6f-4377-9d8b-d1e99b43012d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:10.211005 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cf5858c7-8c6f-4377-9d8b-d1e99b43012d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:10.342043 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-cf5858c7-8c6f-4377-9d8b-d1e99b43012d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:10.349757 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-cf5858c7-8c6f-4377-9d8b-d1e99b43012d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70" status: 200 len: 1507 microversion: 2.1 time: 0.153303 Oct 14 13:08:10.350322 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 446/896] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:10 2022] GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:28.725048 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-970b9cae-dcb0-47ec-a433-07dbe2f177ab tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46cb72f4-40ef-4178-a58f-55c9f8dae61f", "device": "/dev/sdb"}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:08:28.728558 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-970b9cae-dcb0-47ec-a433-07dbe2f177ab tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:28.730708 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=2 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:28.731384 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=6 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:28.732407 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:28.733095 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=29 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:28.739592 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-970b9cae-dcb0-47ec-a433-07dbe2f177ab tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:28.740079 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-970b9cae-dcb0-47ec-a433-07dbe2f177ab tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:28.740520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-970b9cae-dcb0-47ec-a433-07dbe2f177ab tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:28.741219 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-970b9cae-dcb0-47ec-a433-07dbe2f177ab tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:28.741718 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-970b9cae-dcb0-47ec-a433-07dbe2f177ab tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:28.742190 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-970b9cae-dcb0-47ec-a433-07dbe2f177ab tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:28.977354 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-970b9cae-dcb0-47ec-a433-07dbe2f177ab tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "POST /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255618 Oct 14 13:08:28.978014 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 451/897] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Oct 14 13:08:28 2022] POST /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:08:35.694060 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-3736c114-142b-4f06-aa72-52ab8d61816c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1354648957"}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:08:35.694610 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-3736c114-142b-4f06-aa72-52ab8d61816c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:35.696797 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:35.697842 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=23 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:35.698491 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=15 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:35.705174 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3736c114-142b-4f06-aa72-52ab8d61816c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:35.705698 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3736c114-142b-4f06-aa72-52ab8d61816c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:35.706135 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3736c114-142b-4f06-aa72-52ab8d61816c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:35.706823 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3736c114-142b-4f06-aa72-52ab8d61816c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:35.707274 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3736c114-142b-4f06-aa72-52ab8d61816c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:35.707699 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3736c114-142b-4f06-aa72-52ab8d61816c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:35.835719 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.network.security_group_api [None req-3736c114-142b-4f06-aa72-52ab8d61816c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Removing security group 0bdcc557-14cd-4de6-b422-2ca94b79a230 from port 4bcf9a4a-8080-4b16-96b8-764c513ef541 Oct 14 13:08:36.138551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-3736c114-142b-4f06-aa72-52ab8d61816c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "POST /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/action" status: 202 len: 0 microversion: 2.1 time: 0.448284 Oct 14 13:08:36.139160 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 447/898] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Oct 14 13:08:35 2022] POST /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:08:36.148572 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-7507a0f2-988d-419e-8930-a6451c162df8 req-32625d67-5857-416a-bb9a-edda18d885d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62efbcc1-3060-4f79-9a6e-725a62576d91", "tag": "4bcf9a4a-8080-4b16-96b8-764c513ef541"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:08:36.160431 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-7507a0f2-988d-419e-8930-a6451c162df8 req-32625d67-5857-416a-bb9a-edda18d885d1 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:36.160854 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-7507a0f2-988d-419e-8930-a6451c162df8 req-32625d67-5857-416a-bb9a-edda18d885d1 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:36.161629 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-7507a0f2-988d-419e-8930-a6451c162df8 req-32625d67-5857-416a-bb9a-edda18d885d1 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:36.174286 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-7507a0f2-988d-419e-8930-a6451c162df8 req-32625d67-5857-416a-bb9a-edda18d885d1 service nova] Creating event network-changed:4bcf9a4a-8080-4b16-96b8-764c513ef541 for instance 62efbcc1-3060-4f79-9a6e-725a62576d91 on hv-cinder-82099 Oct 14 13:08:36.179701 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-7507a0f2-988d-419e-8930-a6451c162df8 req-32625d67-5857-416a-bb9a-edda18d885d1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035073 Oct 14 13:08:36.180600 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 452/899] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:08:37.125332 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-00174f37-d060-42fc-9726-3a087b419c48 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:37.125874 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-00174f37-d060-42fc-9726-3a087b419c48 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:37.131772 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00174f37-d060-42fc-9726-3a087b419c48 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:37.132248 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00174f37-d060-42fc-9726-3a087b419c48 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:37.132684 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00174f37-d060-42fc-9726-3a087b419c48 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:37.133369 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00174f37-d060-42fc-9726-3a087b419c48 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:37.133851 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00174f37-d060-42fc-9726-3a087b419c48 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:37.134821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00174f37-d060-42fc-9726-3a087b419c48 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:37.218797 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-00174f37-d060-42fc-9726-3a087b419c48 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lazy-loading 'services' on Instance uuid 62efbcc1-3060-4f79-9a6e-725a62576d91 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:08:37.291800 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-00174f37-d060-42fc-9726-3a087b419c48 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "DELETE /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments/ff770f67-5986-4d6c-995b-b8029c57c919" status: 202 len: 0 microversion: 2.1 time: 0.170697 Oct 14 13:08:37.292393 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 448/900] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Oct 14 13:08:37 2022] DELETE /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments/ff770f67-5986-4d6c-995b-b8029c57c919 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 14 13:08:37.301627 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-25ea999d-4ab2-4e71-a46f-0c5b5c99a13a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:37.303924 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-25ea999d-4ab2-4e71-a46f-0c5b5c99a13a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:37.310960 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25ea999d-4ab2-4e71-a46f-0c5b5c99a13a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:37.311457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25ea999d-4ab2-4e71-a46f-0c5b5c99a13a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:37.311897 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25ea999d-4ab2-4e71-a46f-0c5b5c99a13a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:37.312607 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25ea999d-4ab2-4e71-a46f-0c5b5c99a13a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:37.313085 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25ea999d-4ab2-4e71-a46f-0c5b5c99a13a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:37.313550 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-25ea999d-4ab2-4e71-a46f-0c5b5c99a13a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:37.343768 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-25ea999d-4ab2-4e71-a46f-0c5b5c99a13a tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046839 Oct 14 13:08:37.344336 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 453/901] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:08:37 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:08:38.196502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-bbcba86d-6935-4455-b8d1-e3281156b5b0 req-97228149-7162-42b6-b92b-9d242e26b70c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62efbcc1-3060-4f79-9a6e-725a62576d91", "tag": "4bcf9a4a-8080-4b16-96b8-764c513ef541"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:08:38.206038 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-bbcba86d-6935-4455-b8d1-e3281156b5b0 req-97228149-7162-42b6-b92b-9d242e26b70c service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:38.206507 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-bbcba86d-6935-4455-b8d1-e3281156b5b0 req-97228149-7162-42b6-b92b-9d242e26b70c service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:38.206929 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-bbcba86d-6935-4455-b8d1-e3281156b5b0 req-97228149-7162-42b6-b92b-9d242e26b70c service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:38.217854 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-bbcba86d-6935-4455-b8d1-e3281156b5b0 req-97228149-7162-42b6-b92b-9d242e26b70c service nova] Creating event network-changed:4bcf9a4a-8080-4b16-96b8-764c513ef541 for instance 62efbcc1-3060-4f79-9a6e-725a62576d91 on hv-cinder-82099 Oct 14 13:08:38.222673 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-bbcba86d-6935-4455-b8d1-e3281156b5b0 req-97228149-7162-42b6-b92b-9d242e26b70c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030668 Oct 14 13:08:38.223246 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 449/902] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:08:38.357729 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-3728f181-d522-4c44-86b7-b3f15bab1a41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:38.359988 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-3728f181-d522-4c44-86b7-b3f15bab1a41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:38.367477 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3728f181-d522-4c44-86b7-b3f15bab1a41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:38.367986 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3728f181-d522-4c44-86b7-b3f15bab1a41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:38.370617 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3728f181-d522-4c44-86b7-b3f15bab1a41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:38.371576 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3728f181-d522-4c44-86b7-b3f15bab1a41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:38.372245 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3728f181-d522-4c44-86b7-b3f15bab1a41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:38.372737 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3728f181-d522-4c44-86b7-b3f15bab1a41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:38.404548 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-3728f181-d522-4c44-86b7-b3f15bab1a41 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052015 Oct 14 13:08:38.409383 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 454/903] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:08:38 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:08:39.418514 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-1011f087-d66a-42e2-a13d-2660f4a0d9d5 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:39.420744 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-1011f087-d66a-42e2-a13d-2660f4a0d9d5 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:39.426886 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1011f087-d66a-42e2-a13d-2660f4a0d9d5 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:39.427362 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1011f087-d66a-42e2-a13d-2660f4a0d9d5 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:39.427787 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1011f087-d66a-42e2-a13d-2660f4a0d9d5 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:39.428465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1011f087-d66a-42e2-a13d-2660f4a0d9d5 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:39.428908 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1011f087-d66a-42e2-a13d-2660f4a0d9d5 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:39.429323 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1011f087-d66a-42e2-a13d-2660f4a0d9d5 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:39.457672 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-1011f087-d66a-42e2-a13d-2660f4a0d9d5 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044580 Oct 14 13:08:39.458205 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 450/904] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:08:39 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:08:40.470820 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-7989b40a-b93c-4bc7-9bf6-5a9c1fcb3c20 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:40.472930 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-7989b40a-b93c-4bc7-9bf6-5a9c1fcb3c20 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:40.479483 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7989b40a-b93c-4bc7-9bf6-5a9c1fcb3c20 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:40.479963 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7989b40a-b93c-4bc7-9bf6-5a9c1fcb3c20 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:40.480396 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7989b40a-b93c-4bc7-9bf6-5a9c1fcb3c20 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:40.481242 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7989b40a-b93c-4bc7-9bf6-5a9c1fcb3c20 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:40.481801 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7989b40a-b93c-4bc7-9bf6-5a9c1fcb3c20 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:40.482308 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-7989b40a-b93c-4bc7-9bf6-5a9c1fcb3c20 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:40.511900 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-7989b40a-b93c-4bc7-9bf6-5a9c1fcb3c20 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045131 Oct 14 13:08:40.512437 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 455/905] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:08:40 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:08:41.524191 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ec7a1ceb-1bb3-46c2-8986-d009e9e70753 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:41.527083 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ec7a1ceb-1bb3-46c2-8986-d009e9e70753 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:41.533401 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec7a1ceb-1bb3-46c2-8986-d009e9e70753 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:41.533914 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec7a1ceb-1bb3-46c2-8986-d009e9e70753 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:41.534345 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec7a1ceb-1bb3-46c2-8986-d009e9e70753 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:41.535025 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec7a1ceb-1bb3-46c2-8986-d009e9e70753 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:41.535474 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec7a1ceb-1bb3-46c2-8986-d009e9e70753 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:41.535903 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ec7a1ceb-1bb3-46c2-8986-d009e9e70753 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:41.564337 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ec7a1ceb-1bb3-46c2-8986-d009e9e70753 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044093 Oct 14 13:08:41.564880 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 451/906] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:08:41 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:08:42.576308 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-04723228-7b9d-4275-ae69-9cc5a07b695c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:42.578468 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-04723228-7b9d-4275-ae69-9cc5a07b695c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:42.584876 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04723228-7b9d-4275-ae69-9cc5a07b695c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:42.585354 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04723228-7b9d-4275-ae69-9cc5a07b695c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:42.585830 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04723228-7b9d-4275-ae69-9cc5a07b695c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:42.586511 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04723228-7b9d-4275-ae69-9cc5a07b695c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:42.586958 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04723228-7b9d-4275-ae69-9cc5a07b695c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:42.587376 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04723228-7b9d-4275-ae69-9cc5a07b695c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:42.616233 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-04723228-7b9d-4275-ae69-9cc5a07b695c tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043933 Oct 14 13:08:42.616765 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 456/907] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Oct 14 13:08:42 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 14 13:08:42.627173 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-58c2d5b7-c8ab-4578-a16a-257539cba735 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:42.627669 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-58c2d5b7-c8ab-4578-a16a-257539cba735 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:42.634083 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-58c2d5b7-c8ab-4578-a16a-257539cba735 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:42.634633 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-58c2d5b7-c8ab-4578-a16a-257539cba735 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:42.635072 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-58c2d5b7-c8ab-4578-a16a-257539cba735 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:42.635753 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-58c2d5b7-c8ab-4578-a16a-257539cba735 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:42.636204 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-58c2d5b7-c8ab-4578-a16a-257539cba735 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:42.636628 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-58c2d5b7-c8ab-4578-a16a-257539cba735 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:42.708933 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-58c2d5b7-c8ab-4578-a16a-257539cba735 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] HTTP exception thrown: Instance 62efbcc1-3060-4f79-9a6e-725a62576d91 is not attached to volume ff770f67-5986-4d6c-995b-b8029c57c919 Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-58c2d5b7-c8ab-4578-a16a-257539cba735 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Request method failure captured: Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: DELETE /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments/ff770f67-5986-4d6c-995b-b8029c57c919 HTTP/1.1 Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV62taNFAqtvvbmJDFM3fhq_eGdG_o626SJvH1HsVXPRCqM9XsnfPJyucC24oMUE-fsx4FpbadT93yUCiKCuveygaplldmnGlvLFnqJmDvRzFhqDq-6OodF1cdkbBdG9fXzrM-EJaW-yQaGWcuOGrb_EEr_C6blRF1dR86PALc4d2Go Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: d79493455fcd4feabbbecbe929e0f5fc Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-TestMinimumBasicScenario-589280020 Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:08:42.717884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:08:42.719597 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d79493455fcd4feabbbecbe929e0f5fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d79493455fcd4feabbbecbe929e0f5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d79493455fcd4feabbbecbe929e0f5fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d79493455fcd4feabbbecbe929e0f5fc", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:08:42.719597 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-TestMinimumBasicScenario-589280020 Oct 14 13:08:42.719597 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: d79493455fcd4feabbbecbe929e0f5fc Oct 14 13:08:42.719597 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-TestMinimumBasicScenario-589280020 Oct 14 13:08:42.719597 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-TestMinimumBasicScenario-589280020-project Oct 14 13:08:42.719597 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:08:42.719597 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:08:42.719597 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 75c10f4846c2498e8cc93a3c3c5ecdd9 Oct 14 13:08:42.719597 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-TestMinimumBasicScenario-589280020-project Oct 14 13:08:42.719597 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:08:42.719597 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 62efbcc1-3060-4f79-9a6e-725a62576d91 is not attached to volume ff770f67-5986-4d6c-995b-b8029c57c919 Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'server_id': '62efbcc1-3060-4f79-9a6e-725a62576d91', 'id': 'ff770f67-5986-4d6c-995b-b8029c57c919'} Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ff770f67-5986-4d6c-995b-b8029c57c919. Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:08:42.720524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:08:42.722206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:08:42.722206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 14 13:08:42.722206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 14 13:08:42.722206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62efbcc1-3060-4f79-9a6e-725a62576d91 is not attached to volume ff770f67-5986-4d6c-995b-b8029c57c919 Oct 14 13:08:42.722206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:08:42.722206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:08:42.722206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:08:42.722206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:08:42.722206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:08:42.722206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:08:42.722206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:08:42.722206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:08:42.722206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62efbcc1-3060-4f79-9a6e-725a62576d91 is not attached to volume ff770f67-5986-4d6c-995b-b8029c57c919 Oct 14 13:08:42.722206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:08:42.722206 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-58c2d5b7-c8ab-4578-a16a-257539cba735 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Returning 404 to user: Instance 62efbcc1-3060-4f79-9a6e-725a62576d91 is not attached to volume ff770f67-5986-4d6c-995b-b8029c57c919 {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:08:42.723462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-58c2d5b7-c8ab-4578-a16a-257539cba735 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "DELETE /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments/ff770f67-5986-4d6c-995b-b8029c57c919" status: 404 len: 154 microversion: 2.1 time: 0.096092 Oct 14 13:08:42.723462 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 452/908] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Oct 14 13:08:42 2022] DELETE /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91/os-volume_attachments/ff770f67-5986-4d6c-995b-b8029c57c919 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:08:43.856813 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5d73cfa2-7d67-47a9-b7fc-2895eecf23a1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:43.857311 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5d73cfa2-7d67-47a9-b7fc-2895eecf23a1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:43.863822 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5d73cfa2-7d67-47a9-b7fc-2895eecf23a1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:43.864300 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5d73cfa2-7d67-47a9-b7fc-2895eecf23a1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:43.864732 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5d73cfa2-7d67-47a9-b7fc-2895eecf23a1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:43.865415 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5d73cfa2-7d67-47a9-b7fc-2895eecf23a1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:43.865895 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5d73cfa2-7d67-47a9-b7fc-2895eecf23a1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:43.866315 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5d73cfa2-7d67-47a9-b7fc-2895eecf23a1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:43.892653 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5d73cfa2-7d67-47a9-b7fc-2895eecf23a1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Going to try to terminate instance {{(pid=118868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:08:43.962445 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5d73cfa2-7d67-47a9-b7fc-2895eecf23a1 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "DELETE /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 204 len: 0 microversion: 2.1 time: 0.109731 Oct 14 13:08:43.963028 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 457/909] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:08:43 2022] DELETE /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:08:43.971066 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-284eec28-9bf4-4c6d-a13f-09a3037f500b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:43.971670 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-284eec28-9bf4-4c6d-a13f-09a3037f500b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:43.979109 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-284eec28-9bf4-4c6d-a13f-09a3037f500b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:43.979661 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-284eec28-9bf4-4c6d-a13f-09a3037f500b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:43.980478 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-284eec28-9bf4-4c6d-a13f-09a3037f500b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:43.981786 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-284eec28-9bf4-4c6d-a13f-09a3037f500b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:43.982760 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-284eec28-9bf4-4c6d-a13f-09a3037f500b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:43.982760 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-284eec28-9bf4-4c6d-a13f-09a3037f500b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:44.110891 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-284eec28-9bf4-4c6d-a13f-09a3037f500b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:44.118470 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-284eec28-9bf4-4c6d-a13f-09a3037f500b tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1553 microversion: 2.1 time: 0.151235 Oct 14 13:08:44.119021 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 453/910] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:43 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:45.142450 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4c59eaff-f646-417e-824d-cebe84e23b50 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:45.143147 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-4c59eaff-f646-417e-824d-cebe84e23b50 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:45.149424 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4c59eaff-f646-417e-824d-cebe84e23b50 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:45.149935 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4c59eaff-f646-417e-824d-cebe84e23b50 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:45.150366 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4c59eaff-f646-417e-824d-cebe84e23b50 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:45.151047 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4c59eaff-f646-417e-824d-cebe84e23b50 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:45.151497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4c59eaff-f646-417e-824d-cebe84e23b50 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:45.151920 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4c59eaff-f646-417e-824d-cebe84e23b50 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:45.279417 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-4c59eaff-f646-417e-824d-cebe84e23b50 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:45.287094 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4c59eaff-f646-417e-824d-cebe84e23b50 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1553 microversion: 2.1 time: 0.148855 Oct 14 13:08:45.287648 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 458/911] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:45 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:46.310727 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-8ae9498b-58df-422d-bd0e-33e9eb3548b2 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:46.311434 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-8ae9498b-58df-422d-bd0e-33e9eb3548b2 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:46.318617 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ae9498b-58df-422d-bd0e-33e9eb3548b2 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:46.319249 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ae9498b-58df-422d-bd0e-33e9eb3548b2 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:46.319687 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ae9498b-58df-422d-bd0e-33e9eb3548b2 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:46.320376 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ae9498b-58df-422d-bd0e-33e9eb3548b2 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:46.320822 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ae9498b-58df-422d-bd0e-33e9eb3548b2 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:46.321396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-8ae9498b-58df-422d-bd0e-33e9eb3548b2 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:46.454844 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-8ae9498b-58df-422d-bd0e-33e9eb3548b2 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:46.464144 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-8ae9498b-58df-422d-bd0e-33e9eb3548b2 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1553 microversion: 2.1 time: 0.157358 Oct 14 13:08:46.464705 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 454/912] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:46 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:47.487878 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-c5784b45-273f-4668-82dc-fe2a2aec9c57 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:47.488495 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-c5784b45-273f-4668-82dc-fe2a2aec9c57 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:47.495005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c5784b45-273f-4668-82dc-fe2a2aec9c57 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:47.495495 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c5784b45-273f-4668-82dc-fe2a2aec9c57 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:47.495937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c5784b45-273f-4668-82dc-fe2a2aec9c57 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:47.496638 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c5784b45-273f-4668-82dc-fe2a2aec9c57 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:47.497090 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c5784b45-273f-4668-82dc-fe2a2aec9c57 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:47.497539 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-c5784b45-273f-4668-82dc-fe2a2aec9c57 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:47.633850 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-c5784b45-273f-4668-82dc-fe2a2aec9c57 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:47.642236 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-c5784b45-273f-4668-82dc-fe2a2aec9c57 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1553 microversion: 2.1 time: 0.158455 Oct 14 13:08:47.642796 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 459/913] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:47 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:48.234511 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-c54a4da0-0335-4ed5-a9bc-7b474757e008 req-23b9ecb2-818f-4027-817d-c21ed2e8bdd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62efbcc1-3060-4f79-9a6e-725a62576d91", "name": "network-vif-deleted", "tag": "4bcf9a4a-8080-4b16-96b8-764c513ef541"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:08:48.247607 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-c54a4da0-0335-4ed5-a9bc-7b474757e008 req-23b9ecb2-818f-4027-817d-c21ed2e8bdd5 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:48.248077 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-c54a4da0-0335-4ed5-a9bc-7b474757e008 req-23b9ecb2-818f-4027-817d-c21ed2e8bdd5 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:48.248504 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-c54a4da0-0335-4ed5-a9bc-7b474757e008 req-23b9ecb2-818f-4027-817d-c21ed2e8bdd5 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:48.261672 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-c54a4da0-0335-4ed5-a9bc-7b474757e008 req-23b9ecb2-818f-4027-817d-c21ed2e8bdd5 service nova] Creating event network-vif-deleted:4bcf9a4a-8080-4b16-96b8-764c513ef541 for instance 62efbcc1-3060-4f79-9a6e-725a62576d91 on hv-cinder-82099 Oct 14 13:08:48.266656 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-c54a4da0-0335-4ed5-a9bc-7b474757e008 req-23b9ecb2-818f-4027-817d-c21ed2e8bdd5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035836 Oct 14 13:08:48.267239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 455/914] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:08:48.667026 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e99adae4-c122-4884-8413-7a7bb1cd4a3d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:48.667708 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e99adae4-c122-4884-8413-7a7bb1cd4a3d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:48.674422 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e99adae4-c122-4884-8413-7a7bb1cd4a3d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:48.675101 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e99adae4-c122-4884-8413-7a7bb1cd4a3d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:48.675516 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e99adae4-c122-4884-8413-7a7bb1cd4a3d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:48.676503 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e99adae4-c122-4884-8413-7a7bb1cd4a3d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:48.677244 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e99adae4-c122-4884-8413-7a7bb1cd4a3d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:48.677712 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e99adae4-c122-4884-8413-7a7bb1cd4a3d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:48.712305 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e99adae4-c122-4884-8413-7a7bb1cd4a3d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:48.713340 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e99adae4-c122-4884-8413-7a7bb1cd4a3d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:48.713806 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e99adae4-c122-4884-8413-7a7bb1cd4a3d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:48.714250 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.objects.instance [None req-e99adae4-c122-4884-8413-7a7bb1cd4a3d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lazy-loading 'fault' on Instance uuid 62efbcc1-3060-4f79-9a6e-725a62576d91 {{(pid=118868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:08:48.757678 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e99adae4-c122-4884-8413-7a7bb1cd4a3d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c10f4846c2498e8cc93a3c3c5ecdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd79493455fcd4feabbbecbe929e0f5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:48.766398 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e99adae4-c122-4884-8413-7a7bb1cd4a3d tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 200 len: 1348 microversion: 2.1 time: 0.103880 Oct 14 13:08:48.767142 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 460/915] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:48 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 1348 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:49.583149 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5e7124ff-e757-46a0-bfef-021f71e01e59 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:49.583763 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5e7124ff-e757-46a0-bfef-021f71e01e59 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:49.590366 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5e7124ff-e757-46a0-bfef-021f71e01e59 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:49.590848 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5e7124ff-e757-46a0-bfef-021f71e01e59 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:49.591281 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5e7124ff-e757-46a0-bfef-021f71e01e59 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:49.591965 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5e7124ff-e757-46a0-bfef-021f71e01e59 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:49.592423 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5e7124ff-e757-46a0-bfef-021f71e01e59 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:49.592844 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5e7124ff-e757-46a0-bfef-021f71e01e59 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:49.672570 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-5e7124ff-e757-46a0-bfef-021f71e01e59 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lazy-loading 'services' on Instance uuid fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:08:49.743794 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5e7124ff-e757-46a0-bfef-021f71e01e59 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70/os-volume_attachments/46cb72f4-40ef-4178-a58f-55c9f8dae61f" status: 202 len: 0 microversion: 2.1 time: 0.164753 Oct 14 13:08:49.745369 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 456/916] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Oct 14 13:08:49 2022] DELETE /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70/os-volume_attachments/46cb72f4-40ef-4178-a58f-55c9f8dae61f => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:08:49.790029 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-fb699929-d59a-4359-b6bd-8a7c28a53097 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:49.790688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-fb699929-d59a-4359-b6bd-8a7c28a53097 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] [instance: 62efbcc1-3060-4f79-9a6e-725a62576d91] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:49.797998 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fb699929-d59a-4359-b6bd-8a7c28a53097 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:49.798348 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fb699929-d59a-4359-b6bd-8a7c28a53097 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:49.798781 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fb699929-d59a-4359-b6bd-8a7c28a53097 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:49.799657 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fb699929-d59a-4359-b6bd-8a7c28a53097 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:49.800114 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fb699929-d59a-4359-b6bd-8a7c28a53097 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:49.800538 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fb699929-d59a-4359-b6bd-8a7c28a53097 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:49.814759 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-fb699929-d59a-4359-b6bd-8a7c28a53097 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] HTTP exception thrown: Instance 62efbcc1-3060-4f79-9a6e-725a62576d91 could not be found. Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-fb699929-d59a-4359-b6bd-8a7c28a53097 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Request method failure captured: Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 HTTP/1.1 Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV62taNFAqtvvbmJDFM3fhq_eGdG_o626SJvH1HsVXPRCqM9XsnfPJyucC24oMUE-fsx4FpbadT93yUCiKCuveygaplldmnGlvLFnqJmDvRzFhqDq-6OodF1cdkbBdG9fXzrM-EJaW-yQaGWcuOGrb_EEr_C6blRF1dR86PALc4d2Go Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: d79493455fcd4feabbbecbe929e0f5fc Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-TestMinimumBasicScenario-589280020 Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:08:49.816418 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:08:49.818184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d79493455fcd4feabbbecbe929e0f5fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d79493455fcd4feabbbecbe929e0f5fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d79493455fcd4feabbbecbe929e0f5fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d79493455fcd4feabbbecbe929e0f5fc", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:08:49.818184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-TestMinimumBasicScenario-589280020 Oct 14 13:08:49.818184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: d79493455fcd4feabbbecbe929e0f5fc Oct 14 13:08:49.818184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-TestMinimumBasicScenario-589280020 Oct 14 13:08:49.818184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-TestMinimumBasicScenario-589280020-project Oct 14 13:08:49.818184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:08:49.818184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:08:49.818184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 75c10f4846c2498e8cc93a3c3c5ecdd9 Oct 14 13:08:49.818184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-TestMinimumBasicScenario-589280020-project Oct 14 13:08:49.818184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:08:49.818184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance 62efbcc1-3060-4f79-9a6e-725a62576d91 could not be found. Oct 14 13:08:49.818184 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '62efbcc1-3060-4f79-9a6e-725a62576d91'} Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62efbcc1-3060-4f79-9a6e-725a62576d91 could not be found. Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:08:49.819156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62efbcc1-3060-4f79-9a6e-725a62576d91 could not be found. Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62efbcc1-3060-4f79-9a6e-725a62576d91 could not be found. Oct 14 13:08:49.820743 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:08:49.822872 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-fb699929-d59a-4359-b6bd-8a7c28a53097 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Returning 404 to user: Instance 62efbcc1-3060-4f79-9a6e-725a62576d91 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:08:49.823710 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-fb699929-d59a-4359-b6bd-8a7c28a53097 tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91" status: 404 len: 111 microversion: 2.1 time: 0.037580 Oct 14 13:08:49.824246 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 461/917] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:49 2022] GET /compute/v2.1/servers/62efbcc1-3060-4f79-9a6e-725a62576d91 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 13:08:49.832990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ebaf64aa-e3ec-4bd2-8f85-d2745162c07f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] Calling method '.version_select at 0x7fbb81948dc0>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:49.853295 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ebaf64aa-e3ec-4bd2-8f85-d2745162c07f tempest-TestMinimumBasicScenario-589280020 tempest-TestMinimumBasicScenario-589280020-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1954120748" status: 202 len: 0 microversion: 2.1 time: 0.024473 Oct 14 13:08:49.854409 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 457/918] 10.222.0.47 () {58 vars in 1272 bytes} [Fri Oct 14 13:08:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1954120748 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:08:50.879296 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-19445a7b-bc71-417e-8be7-9f514733f75f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:50.879821 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-19445a7b-bc71-417e-8be7-9f514733f75f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:50.887561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19445a7b-bc71-417e-8be7-9f514733f75f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:50.888289 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19445a7b-bc71-417e-8be7-9f514733f75f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:50.888730 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19445a7b-bc71-417e-8be7-9f514733f75f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:50.889437 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19445a7b-bc71-417e-8be7-9f514733f75f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:50.889919 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19445a7b-bc71-417e-8be7-9f514733f75f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:50.890352 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-19445a7b-bc71-417e-8be7-9f514733f75f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:50.915570 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-19445a7b-bc71-417e-8be7-9f514733f75f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Going to try to terminate instance {{(pid=118868) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:08:50.995488 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-19445a7b-bc71-417e-8be7-9f514733f75f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "DELETE /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70" status: 204 len: 0 microversion: 2.1 time: 0.120171 Oct 14 13:08:50.996474 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 462/919] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:08:50 2022] DELETE /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:08:51.005364 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-668ce783-3f81-462b-9050-69cd62adad50 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:51.006131 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-668ce783-3f81-462b-9050-69cd62adad50 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:51.013466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-668ce783-3f81-462b-9050-69cd62adad50 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:51.013977 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-668ce783-3f81-462b-9050-69cd62adad50 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:51.014410 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-668ce783-3f81-462b-9050-69cd62adad50 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:51.015104 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-668ce783-3f81-462b-9050-69cd62adad50 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:51.015560 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-668ce783-3f81-462b-9050-69cd62adad50 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:51.015988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-668ce783-3f81-462b-9050-69cd62adad50 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:51.216880 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-668ce783-3f81-462b-9050-69cd62adad50 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:51.224878 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-668ce783-3f81-462b-9050-69cd62adad50 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70" status: 200 len: 1513 microversion: 2.1 time: 0.223846 Oct 14 13:08:51.225433 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 458/920] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:50 2022] GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:52.250868 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-b97ec529-6882-4cb4-b57d-d0b742bf8abe tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:52.252429 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-b97ec529-6882-4cb4-b57d-d0b742bf8abe tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:52.264835 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b97ec529-6882-4cb4-b57d-d0b742bf8abe tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:52.265560 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b97ec529-6882-4cb4-b57d-d0b742bf8abe tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:52.266183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b97ec529-6882-4cb4-b57d-d0b742bf8abe tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:52.267422 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b97ec529-6882-4cb4-b57d-d0b742bf8abe tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:52.268038 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b97ec529-6882-4cb4-b57d-d0b742bf8abe tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:52.268621 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-b97ec529-6882-4cb4-b57d-d0b742bf8abe tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:52.426711 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-b97ec529-6882-4cb4-b57d-d0b742bf8abe tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:52.430274 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:08:52.435878 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-b97ec529-6882-4cb4-b57d-d0b742bf8abe tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70" status: 200 len: 1513 microversion: 2.1 time: 0.190625 Oct 14 13:08:52.436461 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 463/921] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:52 2022] GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:53.461115 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-3d0e841b-2a23-4d72-b6c7-b1d908450325 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:53.462304 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-3d0e841b-2a23-4d72-b6c7-b1d908450325 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:53.492061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-a88c6b2c-1a9f-4679-b106-cbf49d011cee req-cb935be7-456b-40f7-8c42-1fb042074e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70", "name": "network-vif-deleted", "tag": "99637d80-6745-4a09-a224-f4310e8b4982"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:08:53.502752 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3d0e841b-2a23-4d72-b6c7-b1d908450325 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:53.505731 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3d0e841b-2a23-4d72-b6c7-b1d908450325 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:53.506260 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3d0e841b-2a23-4d72-b6c7-b1d908450325 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:53.508290 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3d0e841b-2a23-4d72-b6c7-b1d908450325 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:53.514424 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3d0e841b-2a23-4d72-b6c7-b1d908450325 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:53.515125 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3d0e841b-2a23-4d72-b6c7-b1d908450325 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:53.525143 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-a88c6b2c-1a9f-4679-b106-cbf49d011cee req-cb935be7-456b-40f7-8c42-1fb042074e3a service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:53.526820 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-a88c6b2c-1a9f-4679-b106-cbf49d011cee req-cb935be7-456b-40f7-8c42-1fb042074e3a service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:53.530183 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-a88c6b2c-1a9f-4679-b106-cbf49d011cee req-cb935be7-456b-40f7-8c42-1fb042074e3a service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:53.565064 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-a88c6b2c-1a9f-4679-b106-cbf49d011cee req-cb935be7-456b-40f7-8c42-1fb042074e3a service nova] Creating event network-vif-deleted:99637d80-6745-4a09-a224-f4310e8b4982 for instance fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 on hv-cinder-82099 Oct 14 13:08:53.573550 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-a88c6b2c-1a9f-4679-b106-cbf49d011cee req-cb935be7-456b-40f7-8c42-1fb042074e3a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085785 Oct 14 13:08:53.574152 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 464/922] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:08:53.653149 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-3d0e841b-2a23-4d72-b6c7-b1d908450325 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:08:53.662385 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-3d0e841b-2a23-4d72-b6c7-b1d908450325 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70" status: 200 len: 1471 microversion: 2.1 time: 0.206326 Oct 14 13:08:53.663558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 459/923] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:53 2022] GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 => generated 1471 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:08:54.688799 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-54b7f881-81e5-4ef0-95e1-a70a8753c8e1 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:08:54.689629 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-54b7f881-81e5-4ef0-95e1-a70a8753c8e1 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:08:54.695722 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-54b7f881-81e5-4ef0-95e1-a70a8753c8e1 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:54.696211 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-54b7f881-81e5-4ef0-95e1-a70a8753c8e1 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:54.696651 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-54b7f881-81e5-4ef0-95e1-a70a8753c8e1 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:54.697971 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-54b7f881-81e5-4ef0-95e1-a70a8753c8e1 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:08:54.698428 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-54b7f881-81e5-4ef0-95e1-a70a8753c8e1 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:08:54.698865 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-54b7f881-81e5-4ef0-95e1-a70a8753c8e1 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:08:54.711992 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-54b7f881-81e5-4ef0-95e1-a70a8753c8e1 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] HTTP exception thrown: Instance fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 could not be found. Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-54b7f881-81e5-4ef0-95e1-a70a8753c8e1 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Request method failure captured: Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 HTTP/1.1 Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV8tUFF566HI_7fPBvO52gg-TPiak3SuDJW--HCb3fnCrzRCMiWdKA3YfA3YRUwLGyNXZQvjyE9llbhqkvBLZBBqDbSs8hfAEuAtXsxRmnYZPA-LLAviQW1GMU2-EQojAzqaIcpPFgUNLzXuMsPR1D6zWiBawW-EnF_H7Zg_edxIQ3s Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: bec5bb9b1b73416fb97534f476f2dce2 Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1500421090 Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:08:54.713703 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:08:54.715456 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bec5bb9b1b73416fb97534f476f2dce2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bec5bb9b1b73416fb97534f476f2dce2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bec5bb9b1b73416fb97534f476f2dce2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bec5bb9b1b73416fb97534f476f2dce2", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:08:54.715456 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-VolumesSnapshotTestJSON-1500421090 Oct 14 13:08:54.715456 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: bec5bb9b1b73416fb97534f476f2dce2 Oct 14 13:08:54.715456 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1500421090 Oct 14 13:08:54.715456 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-VolumesSnapshotTestJSON-1500421090-project Oct 14 13:08:54.715456 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:08:54.715456 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:08:54.715456 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 72c8077c28fa40a99c090dc6b11a769b Oct 14 13:08:54.715456 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-VolumesSnapshotTestJSON-1500421090-project Oct 14 13:08:54.715456 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:08:54.715456 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 could not be found. Oct 14 13:08:54.715456 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': 'fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70'} Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 could not be found. Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:08:54.716448 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 could not be found. Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 could not be found. Oct 14 13:08:54.718118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:08:54.719619 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-54b7f881-81e5-4ef0-95e1-a70a8753c8e1 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Returning 404 to user: Instance fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:08:54.719619 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-54b7f881-81e5-4ef0-95e1-a70a8753c8e1 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70" status: 404 len: 111 microversion: 2.1 time: 0.031134 Oct 14 13:08:54.719838 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 465/924] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:08:54 2022] GET /compute/v2.1/servers/fae2ceb4-ed77-4dd1-bd52-3eeb7628cc70 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:09:02.699011 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1032915050", "imageRef": "2e94a144-9688-4285-aa4b-03dd82d7fa5a", "flavorRef": "452", "networks": [{"uuid": "1c2660e1-be1e-4e0b-875b-b00cf5d04c16"}]}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:09:02.763501 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.network.neutron [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] validate_networks() for [('1c2660e1-be1e-4e0b-875b-b00cf5d04c16', None, None, None, None, None)] {{(pid=118869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:09:03.292523 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Flavor limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:09:03.292940 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Image limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:09:03.293432 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Flavor pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:09:03.293892 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Image pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:09:03.294302 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:09:03.303390 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:03.304129 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:03.304733 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:03.305647 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:03.306725 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:03.307148 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:03.325854 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Getting quotas for project bec5bb9b1b73416fb97534f476f2dce2. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:09:03.330293 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Getting quotas for user 72c8077c28fa40a99c090dc6b11a769b and project bec5bb9b1b73416fb97534f476f2dce2. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:09:03.342450 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Going to run 1 instances... {{(pid=118869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:09:03.345005 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2e94a144-9688-4285-aa4b-03dd82d7fa5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:09:03.394049 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-6d73a0e0-e26d-487a-93a2-80f4aa7e8de0 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699326 Oct 14 13:09:03.394688 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 460/925] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:09:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 13:09:03.406061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1e370440-e694-4191-bc65-ae2d2035fef6 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:03.406757 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1e370440-e694-4191-bc65-ae2d2035fef6 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:03.413437 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:03.480819 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-1e370440-e694-4191-bc65-ae2d2035fef6 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:03.495839 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1e370440-e694-4191-bc65-ae2d2035fef6 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2" status: 200 len: 1219 microversion: 2.1 time: 0.093728 Oct 14 13:09:03.496585 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 466/926] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:03 2022] GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:04.519777 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-6a5d04f6-7ef9-45fc-92a8-dbb20af3a75e tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:04.520385 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-6a5d04f6-7ef9-45fc-92a8-dbb20af3a75e tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:04.532996 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6a5d04f6-7ef9-45fc-92a8-dbb20af3a75e tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:04.539774 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6a5d04f6-7ef9-45fc-92a8-dbb20af3a75e tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:04.540355 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6a5d04f6-7ef9-45fc-92a8-dbb20af3a75e tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:04.541118 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6a5d04f6-7ef9-45fc-92a8-dbb20af3a75e tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:04.541609 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6a5d04f6-7ef9-45fc-92a8-dbb20af3a75e tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:04.542212 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6a5d04f6-7ef9-45fc-92a8-dbb20af3a75e tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:04.739521 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-6a5d04f6-7ef9-45fc-92a8-dbb20af3a75e tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:04.754835 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-6a5d04f6-7ef9-45fc-92a8-dbb20af3a75e tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2" status: 200 len: 1289 microversion: 2.1 time: 0.239189 Oct 14 13:09:04.756839 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 461/927] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:04 2022] GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2 => generated 1289 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:05.779784 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0b27d023-25f9-4677-963e-d3b75e648b8c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:05.780334 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0b27d023-25f9-4677-963e-d3b75e648b8c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:05.802237 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=4 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:05.805333 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0b27d023-25f9-4677-963e-d3b75e648b8c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:05.806156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0b27d023-25f9-4677-963e-d3b75e648b8c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:05.806604 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0b27d023-25f9-4677-963e-d3b75e648b8c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:05.807323 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0b27d023-25f9-4677-963e-d3b75e648b8c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:05.807792 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0b27d023-25f9-4677-963e-d3b75e648b8c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:05.808202 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0b27d023-25f9-4677-963e-d3b75e648b8c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:06.028433 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0b27d023-25f9-4677-963e-d3b75e648b8c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:06.045198 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0b27d023-25f9-4677-963e-d3b75e648b8c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2" status: 200 len: 1319 microversion: 2.1 time: 0.269233 Oct 14 13:09:06.045827 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 467/928] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:05 2022] GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:06.100092 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-41525c45-347b-4c5c-9dc0-0f688d6fbad2 req-6b1d97e6-b3a9-42c0-81b6-242936bebd6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "276846e9-b615-4863-8a8f-799cf0114bf2", "tag": "1fac4cbc-4003-4868-96de-947a449bab8c"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:09:06.117268 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:06.125222 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-41525c45-347b-4c5c-9dc0-0f688d6fbad2 req-6b1d97e6-b3a9-42c0-81b6-242936bebd6c service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:06.126259 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-41525c45-347b-4c5c-9dc0-0f688d6fbad2 req-6b1d97e6-b3a9-42c0-81b6-242936bebd6c service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:06.126924 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-41525c45-347b-4c5c-9dc0-0f688d6fbad2 req-6b1d97e6-b3a9-42c0-81b6-242936bebd6c service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:06.148745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:06.152124 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-41525c45-347b-4c5c-9dc0-0f688d6fbad2 req-6b1d97e6-b3a9-42c0-81b6-242936bebd6c service nova] Creating event network-changed:1fac4cbc-4003-4868-96de-947a449bab8c for instance 276846e9-b615-4863-8a8f-799cf0114bf2 on hv-cinder-82099 Oct 14 13:09:06.159582 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-41525c45-347b-4c5c-9dc0-0f688d6fbad2 req-6b1d97e6-b3a9-42c0-81b6-242936bebd6c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066781 Oct 14 13:09:06.161336 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 462/929] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:09:07.072600 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f49e5b4c-64d6-495b-bb28-b3f4c430ac7f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:07.073896 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-f49e5b4c-64d6-495b-bb28-b3f4c430ac7f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:07.084681 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f49e5b4c-64d6-495b-bb28-b3f4c430ac7f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:07.087332 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f49e5b4c-64d6-495b-bb28-b3f4c430ac7f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:07.088592 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f49e5b4c-64d6-495b-bb28-b3f4c430ac7f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:07.090923 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f49e5b4c-64d6-495b-bb28-b3f4c430ac7f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:07.091399 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f49e5b4c-64d6-495b-bb28-b3f4c430ac7f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:07.091836 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f49e5b4c-64d6-495b-bb28-b3f4c430ac7f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:07.316275 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f49e5b4c-64d6-495b-bb28-b3f4c430ac7f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:07.324662 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f49e5b4c-64d6-495b-bb28-b3f4c430ac7f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2" status: 200 len: 1319 microversion: 2.1 time: 0.256230 Oct 14 13:09:07.335792 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 468/930] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:07 2022] GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:08.353812 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-6b473789-25d2-4bc8-9b57-c8d47bbc942f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:08.355857 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-6b473789-25d2-4bc8-9b57-c8d47bbc942f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:08.366282 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6b473789-25d2-4bc8-9b57-c8d47bbc942f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:08.367628 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6b473789-25d2-4bc8-9b57-c8d47bbc942f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:08.368923 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6b473789-25d2-4bc8-9b57-c8d47bbc942f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:08.372616 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6b473789-25d2-4bc8-9b57-c8d47bbc942f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:08.373297 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6b473789-25d2-4bc8-9b57-c8d47bbc942f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:08.373978 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6b473789-25d2-4bc8-9b57-c8d47bbc942f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:08.596235 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-6b473789-25d2-4bc8-9b57-c8d47bbc942f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:08.605199 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-6b473789-25d2-4bc8-9b57-c8d47bbc942f tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2" status: 200 len: 1319 microversion: 2.1 time: 0.255633 Oct 14 13:09:08.618013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 463/931] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:08 2022] GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:09.373395 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-42a5aff5-47b0-44cb-a036-b8ad23f25e0d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Action: 'create', calling method: .version_select at 0x7fbb81add700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1372720141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPy5hpjAcScOMdxePsudlpiG07OJVl7h1HwjVyaG15nGPMsayN1AaIWmcTPlOVUaPHlm2Y8g3b5t0LPamYQuln3b1rNz8S0EDWqrXA5goHHtqiAf8wxV3r8/xhTD+baHOA=="}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:09:09.389708 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-42a5aff5-47b0-44cb-a036-b8ad23f25e0d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Getting quotas for project d5a0e78a09a843b1b6d2eee3ed8f7903. Resources: {'key_pairs'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:09:09.393860 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.quota [None req-42a5aff5-47b0-44cb-a036-b8ad23f25e0d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Getting quotas for user 159c0ca7e417485b8ae497301a669228 and project d5a0e78a09a843b1b6d2eee3ed8f7903. Resources: {'key_pairs'} {{(pid=118868) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:09:09.418207 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-42a5aff5-47b0-44cb-a036-b8ad23f25e0d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.243164 Oct 14 13:09:09.418814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 469/932] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Oct 14 13:09:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:09:09.632464 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-98daf069-449a-47ba-b226-b0469706c333 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:09.633410 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-98daf069-449a-47ba-b226-b0469706c333 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:09.640853 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-98daf069-449a-47ba-b226-b0469706c333 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:09.641445 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-98daf069-449a-47ba-b226-b0469706c333 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:09.641991 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-98daf069-449a-47ba-b226-b0469706c333 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:09.642704 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-98daf069-449a-47ba-b226-b0469706c333 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:09.643160 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-98daf069-449a-47ba-b226-b0469706c333 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:09.643619 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-98daf069-449a-47ba-b226-b0469706c333 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:09.839453 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-98daf069-449a-47ba-b226-b0469706c333 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:09.847885 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-98daf069-449a-47ba-b226-b0469706c333 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2" status: 200 len: 1319 microversion: 2.1 time: 0.219360 Oct 14 13:09:09.848571 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 464/933] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:09 2022] GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:10.873360 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f15b561a-4f79-4897-92ba-f3cbe7c3b71c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:10.874803 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-f15b561a-4f79-4897-92ba-f3cbe7c3b71c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:10.882944 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f15b561a-4f79-4897-92ba-f3cbe7c3b71c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:10.883378 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f15b561a-4f79-4897-92ba-f3cbe7c3b71c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:10.884349 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f15b561a-4f79-4897-92ba-f3cbe7c3b71c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:10.885057 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f15b561a-4f79-4897-92ba-f3cbe7c3b71c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:10.885838 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f15b561a-4f79-4897-92ba-f3cbe7c3b71c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:10.886733 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f15b561a-4f79-4897-92ba-f3cbe7c3b71c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:11.027977 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f15b561a-4f79-4897-92ba-f3cbe7c3b71c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:11.036170 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f15b561a-4f79-4897-92ba-f3cbe7c3b71c tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2" status: 200 len: 1319 microversion: 2.1 time: 0.167073 Oct 14 13:09:11.036924 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 470/934] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:10 2022] GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:11.225067 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-bc4d0f17-69eb-4fb3-8284-839b0d26422c req-22c0dfae-9be3-49b1-829e-15ecbb72c085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276846e9-b615-4863-8a8f-799cf0114bf2", "name": "network-vif-plugged", "status": "completed", "tag": "1fac4cbc-4003-4868-96de-947a449bab8c"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:09:11.240825 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-bc4d0f17-69eb-4fb3-8284-839b0d26422c req-22c0dfae-9be3-49b1-829e-15ecbb72c085 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:11.241301 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-bc4d0f17-69eb-4fb3-8284-839b0d26422c req-22c0dfae-9be3-49b1-829e-15ecbb72c085 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:11.242214 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-bc4d0f17-69eb-4fb3-8284-839b0d26422c req-22c0dfae-9be3-49b1-829e-15ecbb72c085 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:11.261774 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-bc4d0f17-69eb-4fb3-8284-839b0d26422c req-22c0dfae-9be3-49b1-829e-15ecbb72c085 service nova] Creating event network-vif-plugged:1fac4cbc-4003-4868-96de-947a449bab8c for instance 276846e9-b615-4863-8a8f-799cf0114bf2 on hv-cinder-82099 Oct 14 13:09:11.267596 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-bc4d0f17-69eb-4fb3-8284-839b0d26422c req-22c0dfae-9be3-49b1-829e-15ecbb72c085 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045655 Oct 14 13:09:11.268192 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 465/935] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:09:12.060441 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-64ff2b7c-1c64-45fc-8504-9d323c2e58fb tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:12.061059 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-64ff2b7c-1c64-45fc-8504-9d323c2e58fb tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:12.068020 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64ff2b7c-1c64-45fc-8504-9d323c2e58fb tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:12.068520 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64ff2b7c-1c64-45fc-8504-9d323c2e58fb tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:12.068990 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64ff2b7c-1c64-45fc-8504-9d323c2e58fb tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:12.069731 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64ff2b7c-1c64-45fc-8504-9d323c2e58fb tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:12.070194 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64ff2b7c-1c64-45fc-8504-9d323c2e58fb tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:12.070625 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-64ff2b7c-1c64-45fc-8504-9d323c2e58fb tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:12.212973 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-64ff2b7c-1c64-45fc-8504-9d323c2e58fb tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:12.222801 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-64ff2b7c-1c64-45fc-8504-9d323c2e58fb tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2" status: 200 len: 1319 microversion: 2.1 time: 0.166220 Oct 14 13:09:12.224132 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 471/936] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:12 2022] GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:13.251372 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-fa21bad2-5c56-42e0-adb8-e0c2beeaca96 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:13.251978 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-fa21bad2-5c56-42e0-adb8-e0c2beeaca96 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:13.258845 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fa21bad2-5c56-42e0-adb8-e0c2beeaca96 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:13.259355 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fa21bad2-5c56-42e0-adb8-e0c2beeaca96 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:13.259792 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fa21bad2-5c56-42e0-adb8-e0c2beeaca96 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:13.260502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fa21bad2-5c56-42e0-adb8-e0c2beeaca96 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:13.260956 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fa21bad2-5c56-42e0-adb8-e0c2beeaca96 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:13.261377 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fa21bad2-5c56-42e0-adb8-e0c2beeaca96 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:13.316155 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:13.337915 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=6 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:13.395721 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-fa21bad2-5c56-42e0-adb8-e0c2beeaca96 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:13.405214 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-fa21bad2-5c56-42e0-adb8-e0c2beeaca96 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2" status: 200 len: 1507 microversion: 2.1 time: 0.158079 Oct 14 13:09:13.405821 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 466/937] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:13 2022] GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:13.434632 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-47724147-c6e7-4d8e-a3c9-bfc69ab61b91 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41c94436-6774-4711-9011-19a53b892185", "device": "/dev/sdb"}} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:09:13.438007 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-47724147-c6e7-4d8e-a3c9-bfc69ab61b91 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:13.444439 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-47724147-c6e7-4d8e-a3c9-bfc69ab61b91 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:13.444918 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-47724147-c6e7-4d8e-a3c9-bfc69ab61b91 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:13.445354 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-47724147-c6e7-4d8e-a3c9-bfc69ab61b91 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:13.446089 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-47724147-c6e7-4d8e-a3c9-bfc69ab61b91 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:13.446542 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-47724147-c6e7-4d8e-a3c9-bfc69ab61b91 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:13.446962 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-47724147-c6e7-4d8e-a3c9-bfc69ab61b91 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:13.690472 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-47724147-c6e7-4d8e-a3c9-bfc69ab61b91 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "POST /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259645 Oct 14 13:09:13.691151 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 472/938] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Oct 14 13:09:13 2022] POST /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:09:29.979948 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-511113949", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1372720141", "security_groups": [{"name": "tempest-secgroup-smoke-1445989676"}], "block_device_mapping_v2": [{"uuid": "5e027f44-5c1c-4d64-8ad8-c0b058579c0c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8eba902a-eded-44ab-9171-f5f12325a82d"}]}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:09:29.990876 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=9 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:29.991635 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=21 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:30.094162 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.network.neutron [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] validate_networks() for [('8eba902a-eded-44ab-9171-f5f12325a82d', None, None, None, None, None)] {{(pid=118869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:09:30.460650 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Flavor limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:09:30.461069 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Image limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:09:30.461570 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Flavor pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:09:30.461979 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Image pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:09:30.462499 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:09:30.471802 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:30.472313 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:30.472748 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:30.473470 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:30.473963 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:30.474389 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:30.491162 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Getting quotas for project d5a0e78a09a843b1b6d2eee3ed8f7903. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:09:30.495651 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Getting quotas for user 159c0ca7e417485b8ae497301a669228 and project d5a0e78a09a843b1b6d2eee3ed8f7903. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:09:30.552674 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Going to run 1 instances... {{(pid=118869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:09:30.554837 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e027f44-5c1c-4d64-8ad8-c0b058579c0c',volume_size=None,volume_type=None)] {{(pid=118869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:09:30.683309 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-13be8657-1ed9-403c-a326-7b41672b2886 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.707704 Oct 14 13:09:30.683989 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 467/939] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:09:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 13:09:30.695822 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-34d5d453-e00a-46e1-9869-f8b1c74aebc7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:30.696528 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-34d5d453-e00a-46e1-9869-f8b1c74aebc7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:30.699570 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=6 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:30.700481 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:30.701138 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:30.761124 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-34d5d453-e00a-46e1-9869-f8b1c74aebc7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:30.768231 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-34d5d453-e00a-46e1-9869-f8b1c74aebc7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1094 microversion: 2.1 time: 0.076590 Oct 14 13:09:30.768806 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 473/940] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:30 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:31.791396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-51fcbec8-5d20-4a3c-a843-c6647c03344c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:31.792142 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-51fcbec8-5d20-4a3c-a843-c6647c03344c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:31.799396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-51fcbec8-5d20-4a3c-a843-c6647c03344c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:31.800219 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-51fcbec8-5d20-4a3c-a843-c6647c03344c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:31.801016 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-51fcbec8-5d20-4a3c-a843-c6647c03344c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:31.801933 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-51fcbec8-5d20-4a3c-a843-c6647c03344c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:31.802515 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-51fcbec8-5d20-4a3c-a843-c6647c03344c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:31.802945 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-51fcbec8-5d20-4a3c-a843-c6647c03344c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:31.882119 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-51fcbec8-5d20-4a3c-a843-c6647c03344c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:31.890479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-51fcbec8-5d20-4a3c-a843-c6647c03344c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1210 microversion: 2.1 time: 0.103728 Oct 14 13:09:31.891116 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 468/941] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:31 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:31.982006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-1e016692-a1f1-4134-b2eb-a3663c289d35 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:31.982556 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-1e016692-a1f1-4134-b2eb-a3663c289d35 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:31.990787 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1e016692-a1f1-4134-b2eb-a3663c289d35 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:31.991357 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1e016692-a1f1-4134-b2eb-a3663c289d35 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:31.991853 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1e016692-a1f1-4134-b2eb-a3663c289d35 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:31.992637 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1e016692-a1f1-4134-b2eb-a3663c289d35 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:31.993157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1e016692-a1f1-4134-b2eb-a3663c289d35 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:31.993682 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-1e016692-a1f1-4134-b2eb-a3663c289d35 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:32.079042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.objects.instance [None req-1e016692-a1f1-4134-b2eb-a3663c289d35 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lazy-loading 'services' on Instance uuid 276846e9-b615-4863-8a8f-799cf0114bf2 {{(pid=118868) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:09:32.167912 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-1e016692-a1f1-4134-b2eb-a3663c289d35 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "DELETE /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2/os-volume_attachments/41c94436-6774-4711-9011-19a53b892185" status: 202 len: 0 microversion: 2.1 time: 0.190578 Oct 14 13:09:32.168547 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 474/942] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Oct 14 13:09:31 2022] DELETE /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2/os-volume_attachments/41c94436-6774-4711-9011-19a53b892185 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 14 13:09:32.914818 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-b188b932-53c7-47ed-b06a-307e502c72d7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:32.915352 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-b188b932-53c7-47ed-b06a-307e502c72d7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:32.922387 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b188b932-53c7-47ed-b06a-307e502c72d7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:32.922974 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b188b932-53c7-47ed-b06a-307e502c72d7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:32.923495 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b188b932-53c7-47ed-b06a-307e502c72d7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:32.924266 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b188b932-53c7-47ed-b06a-307e502c72d7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:32.924795 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b188b932-53c7-47ed-b06a-307e502c72d7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:32.925230 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b188b932-53c7-47ed-b06a-307e502c72d7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:33.255081 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-b188b932-53c7-47ed-b06a-307e502c72d7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:33.263872 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-b188b932-53c7-47ed-b06a-307e502c72d7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1266 microversion: 2.1 time: 0.353221 Oct 14 13:09:33.264679 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 469/943] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:32 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1266 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:33.312168 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-359ae5e6-55d2-42fd-9f48-58d67759a257 req-d4a86fdc-9a26-4705-9372-bc7bcbc16bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddac68fe-a256-4b03-9006-f69520b2973b", "tag": "49af9af5-59c3-46e1-a7eb-12e6f6097a1b"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:09:33.323859 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-6412b007-5113-47eb-8b33-877672821908 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:33.324348 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-6412b007-5113-47eb-8b33-877672821908 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:33.331158 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-359ae5e6-55d2-42fd-9f48-58d67759a257 req-d4a86fdc-9a26-4705-9372-bc7bcbc16bae service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:33.331861 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-359ae5e6-55d2-42fd-9f48-58d67759a257 req-d4a86fdc-9a26-4705-9372-bc7bcbc16bae service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:33.332454 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-359ae5e6-55d2-42fd-9f48-58d67759a257 req-d4a86fdc-9a26-4705-9372-bc7bcbc16bae service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:33.333224 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6412b007-5113-47eb-8b33-877672821908 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:33.333772 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6412b007-5113-47eb-8b33-877672821908 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:33.334202 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6412b007-5113-47eb-8b33-877672821908 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:33.334894 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6412b007-5113-47eb-8b33-877672821908 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:33.335338 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6412b007-5113-47eb-8b33-877672821908 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:33.335754 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6412b007-5113-47eb-8b33-877672821908 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:33.345828 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-359ae5e6-55d2-42fd-9f48-58d67759a257 req-d4a86fdc-9a26-4705-9372-bc7bcbc16bae service nova] Creating event network-changed:49af9af5-59c3-46e1-a7eb-12e6f6097a1b for instance ddac68fe-a256-4b03-9006-f69520b2973b on hv-cinder-82099 Oct 14 13:09:33.350734 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-359ae5e6-55d2-42fd-9f48-58d67759a257 req-d4a86fdc-9a26-4705-9372-bc7bcbc16bae service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043196 Oct 14 13:09:33.351333 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 475/944] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:09:33.362170 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-6412b007-5113-47eb-8b33-877672821908 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Going to try to terminate instance {{(pid=118869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:09:33.439073 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-6412b007-5113-47eb-8b33-877672821908 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "DELETE /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2" status: 204 len: 0 microversion: 2.1 time: 0.119317 Oct 14 13:09:33.440065 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 470/945] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:09:33 2022] DELETE /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:09:33.449127 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0c41e903-ee0e-4116-8a6f-f4b7da4c9f79 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:33.449806 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0c41e903-ee0e-4116-8a6f-f4b7da4c9f79 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:33.456325 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c41e903-ee0e-4116-8a6f-f4b7da4c9f79 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:33.456818 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c41e903-ee0e-4116-8a6f-f4b7da4c9f79 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:33.457259 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c41e903-ee0e-4116-8a6f-f4b7da4c9f79 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:33.458001 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c41e903-ee0e-4116-8a6f-f4b7da4c9f79 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:33.458460 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c41e903-ee0e-4116-8a6f-f4b7da4c9f79 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:33.458886 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0c41e903-ee0e-4116-8a6f-f4b7da4c9f79 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:33.592522 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0c41e903-ee0e-4116-8a6f-f4b7da4c9f79 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:33.600276 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0c41e903-ee0e-4116-8a6f-f4b7da4c9f79 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2" status: 200 len: 1513 microversion: 2.1 time: 0.155909 Oct 14 13:09:33.600855 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 476/946] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:33 2022] GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:09:34.287537 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-a4c57080-9784-4fcc-8dac-0198d399075e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:34.288167 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-a4c57080-9784-4fcc-8dac-0198d399075e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:34.295141 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a4c57080-9784-4fcc-8dac-0198d399075e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:34.295622 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a4c57080-9784-4fcc-8dac-0198d399075e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:34.296054 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a4c57080-9784-4fcc-8dac-0198d399075e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:34.296765 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a4c57080-9784-4fcc-8dac-0198d399075e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:34.297216 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a4c57080-9784-4fcc-8dac-0198d399075e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:34.297673 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-a4c57080-9784-4fcc-8dac-0198d399075e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:34.423940 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-a4c57080-9784-4fcc-8dac-0198d399075e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:34.432059 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-a4c57080-9784-4fcc-8dac-0198d399075e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1266 microversion: 2.1 time: 0.148255 Oct 14 13:09:34.432611 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 471/947] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:34 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:34.624278 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2f63a509-5f72-49a1-a6d7-db7a4859c463 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:34.624884 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2f63a509-5f72-49a1-a6d7-db7a4859c463 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:34.631495 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f63a509-5f72-49a1-a6d7-db7a4859c463 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:34.632089 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f63a509-5f72-49a1-a6d7-db7a4859c463 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:34.632516 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f63a509-5f72-49a1-a6d7-db7a4859c463 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:34.633195 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f63a509-5f72-49a1-a6d7-db7a4859c463 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:34.633685 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f63a509-5f72-49a1-a6d7-db7a4859c463 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:34.634108 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2f63a509-5f72-49a1-a6d7-db7a4859c463 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:34.764680 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-2f63a509-5f72-49a1-a6d7-db7a4859c463 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:34.773142 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2f63a509-5f72-49a1-a6d7-db7a4859c463 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2" status: 200 len: 1513 microversion: 2.1 time: 0.152749 Oct 14 13:09:34.773750 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 477/948] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:34 2022] GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:35.454869 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-d66426c4-f0d9-4883-bb3e-9628e9c7bccc tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:35.455621 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-d66426c4-f0d9-4883-bb3e-9628e9c7bccc tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:35.463496 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d66426c4-f0d9-4883-bb3e-9628e9c7bccc tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:35.465144 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d66426c4-f0d9-4883-bb3e-9628e9c7bccc tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:35.465620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d66426c4-f0d9-4883-bb3e-9628e9c7bccc tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:35.466368 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d66426c4-f0d9-4883-bb3e-9628e9c7bccc tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:35.466829 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d66426c4-f0d9-4883-bb3e-9628e9c7bccc tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:35.467258 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-d66426c4-f0d9-4883-bb3e-9628e9c7bccc tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:35.796970 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ebd22234-b0b5-4db6-ac06-86e9f2aac63d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:35.797660 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-ebd22234-b0b5-4db6-ac06-86e9f2aac63d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:35.804365 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ebd22234-b0b5-4db6-ac06-86e9f2aac63d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:35.805070 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ebd22234-b0b5-4db6-ac06-86e9f2aac63d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:35.805648 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-d66426c4-f0d9-4883-bb3e-9628e9c7bccc tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:35.805974 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ebd22234-b0b5-4db6-ac06-86e9f2aac63d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:35.806839 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ebd22234-b0b5-4db6-ac06-86e9f2aac63d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:35.807466 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ebd22234-b0b5-4db6-ac06-86e9f2aac63d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:35.808055 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ebd22234-b0b5-4db6-ac06-86e9f2aac63d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:35.815865 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-d66426c4-f0d9-4883-bb3e-9628e9c7bccc tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1266 microversion: 2.1 time: 0.364930 Oct 14 13:09:35.825514 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 472/949] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:35 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1266 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:09:35.909967 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-ebd22234-b0b5-4db6-ac06-86e9f2aac63d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72c8077c28fa40a99c090dc6b11a769b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec5bb9b1b73416fb97534f476f2dce2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:35.912298 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-c3dae031-262a-420a-91a1-95f7f1b355ab req-30675e79-5b49-4238-b93f-464b80528d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "276846e9-b615-4863-8a8f-799cf0114bf2", "name": "network-vif-deleted", "tag": "1fac4cbc-4003-4868-96de-947a449bab8c"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:09:35.921626 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ebd22234-b0b5-4db6-ac06-86e9f2aac63d tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2" status: 200 len: 1471 microversion: 2.1 time: 0.128472 Oct 14 13:09:35.922751 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 478/950] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:35 2022] GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2 => generated 1471 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:09:35.932459 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-c3dae031-262a-420a-91a1-95f7f1b355ab req-30675e79-5b49-4238-b93f-464b80528d31 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:35.933121 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-c3dae031-262a-420a-91a1-95f7f1b355ab req-30675e79-5b49-4238-b93f-464b80528d31 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:35.934323 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-c3dae031-262a-420a-91a1-95f7f1b355ab req-30675e79-5b49-4238-b93f-464b80528d31 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:35.947281 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-c3dae031-262a-420a-91a1-95f7f1b355ab req-30675e79-5b49-4238-b93f-464b80528d31 service nova] Creating event network-vif-deleted:1fac4cbc-4003-4868-96de-947a449bab8c for instance 276846e9-b615-4863-8a8f-799cf0114bf2 on hv-cinder-82099 Oct 14 13:09:35.952044 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-c3dae031-262a-420a-91a1-95f7f1b355ab req-30675e79-5b49-4238-b93f-464b80528d31 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044163 Oct 14 13:09:35.952951 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 473/951] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:09:36.839390 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-0cde2510-50e3-4beb-bf45-cc37875824d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:36.840001 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-0cde2510-50e3-4beb-bf45-cc37875824d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:36.846403 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0cde2510-50e3-4beb-bf45-cc37875824d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:36.846886 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0cde2510-50e3-4beb-bf45-cc37875824d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:36.847320 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0cde2510-50e3-4beb-bf45-cc37875824d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:36.848005 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0cde2510-50e3-4beb-bf45-cc37875824d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:36.848461 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0cde2510-50e3-4beb-bf45-cc37875824d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:36.848881 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-0cde2510-50e3-4beb-bf45-cc37875824d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:36.948636 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4550525d-bdf5-4a49-8d5e-b389c47b88d5 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:36.949363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4550525d-bdf5-4a49-8d5e-b389c47b88d5 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] [instance: 276846e9-b615-4863-8a8f-799cf0114bf2] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:36.955448 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4550525d-bdf5-4a49-8d5e-b389c47b88d5 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:36.955923 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4550525d-bdf5-4a49-8d5e-b389c47b88d5 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:36.956356 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4550525d-bdf5-4a49-8d5e-b389c47b88d5 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:36.957037 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4550525d-bdf5-4a49-8d5e-b389c47b88d5 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:36.957502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4550525d-bdf5-4a49-8d5e-b389c47b88d5 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:36.957925 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4550525d-bdf5-4a49-8d5e-b389c47b88d5 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:36.971894 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-4550525d-bdf5-4a49-8d5e-b389c47b88d5 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] HTTP exception thrown: Instance 276846e9-b615-4863-8a8f-799cf0114bf2 could not be found. Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4550525d-bdf5-4a49-8d5e-b389c47b88d5 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Request method failure captured: Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2 HTTP/1.1 Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV8tUFF566HI_7fPBvO52gg-TPiak3SuDJW--HCb3fnCrzRCMiWdKA3YfA3YRUwLGyNXZQvjyE9llbhqkvBLZBBqDbSs8hfAEuAtXsxRmnYZPA-LLAviQW1GMU2-EQojAzqaIcpPFgUNLzXuMsPR1D6zWiBawW-EnF_H7Zg_edxIQ3s Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: bec5bb9b1b73416fb97534f476f2dce2 Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1500421090 Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:09:36.973518 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:09:36.975262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bec5bb9b1b73416fb97534f476f2dce2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bec5bb9b1b73416fb97534f476f2dce2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bec5bb9b1b73416fb97534f476f2dce2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bec5bb9b1b73416fb97534f476f2dce2", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:09:36.975262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-VolumesSnapshotTestJSON-1500421090 Oct 14 13:09:36.975262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: bec5bb9b1b73416fb97534f476f2dce2 Oct 14 13:09:36.975262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1500421090 Oct 14 13:09:36.975262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-VolumesSnapshotTestJSON-1500421090-project Oct 14 13:09:36.975262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:09:36.975262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:09:36.975262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 72c8077c28fa40a99c090dc6b11a769b Oct 14 13:09:36.975262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-VolumesSnapshotTestJSON-1500421090-project Oct 14 13:09:36.975262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:09:36.975262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance 276846e9-b615-4863-8a8f-799cf0114bf2 could not be found. Oct 14 13:09:36.975262 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': '276846e9-b615-4863-8a8f-799cf0114bf2'} Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 276846e9-b615-4863-8a8f-799cf0114bf2 could not be found. Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:09:36.976130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 276846e9-b615-4863-8a8f-799cf0114bf2 could not be found. Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 276846e9-b615-4863-8a8f-799cf0114bf2 could not be found. Oct 14 13:09:36.977551 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:09:36.978911 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4550525d-bdf5-4a49-8d5e-b389c47b88d5 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] Returning 404 to user: Instance 276846e9-b615-4863-8a8f-799cf0114bf2 could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:09:36.978911 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4550525d-bdf5-4a49-8d5e-b389c47b88d5 tempest-VolumesSnapshotTestJSON-1500421090 tempest-VolumesSnapshotTestJSON-1500421090-project] 10.222.0.47 "GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2" status: 404 len: 111 microversion: 2.1 time: 0.031497 Oct 14 13:09:36.979699 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 474/952] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:36 2022] GET /compute/v2.1/servers/276846e9-b615-4863-8a8f-799cf0114bf2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 14 13:09:37.035072 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-0cde2510-50e3-4beb-bf45-cc37875824d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:37.043507 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-0cde2510-50e3-4beb-bf45-cc37875824d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1266 microversion: 2.1 time: 0.208513 Oct 14 13:09:37.044074 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 479/953] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:36 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:38.065398 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-0bab5f62-f60a-4f64-963d-55842e56306b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:38.066146 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-0bab5f62-f60a-4f64-963d-55842e56306b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:38.072663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0bab5f62-f60a-4f64-963d-55842e56306b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:38.073144 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0bab5f62-f60a-4f64-963d-55842e56306b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:38.073602 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0bab5f62-f60a-4f64-963d-55842e56306b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:38.074293 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0bab5f62-f60a-4f64-963d-55842e56306b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:38.074744 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0bab5f62-f60a-4f64-963d-55842e56306b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:38.075167 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-0bab5f62-f60a-4f64-963d-55842e56306b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:38.202711 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-0bab5f62-f60a-4f64-963d-55842e56306b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:38.210374 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-0bab5f62-f60a-4f64-963d-55842e56306b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1266 microversion: 2.1 time: 0.148855 Oct 14 13:09:38.210933 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 475/954] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:38 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:39.232320 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-5ab0d8e1-eb95-4fb3-b90e-d593e28f2ad4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:39.232884 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-5ab0d8e1-eb95-4fb3-b90e-d593e28f2ad4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:39.239620 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ab0d8e1-eb95-4fb3-b90e-d593e28f2ad4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:39.240102 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ab0d8e1-eb95-4fb3-b90e-d593e28f2ad4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:39.240543 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ab0d8e1-eb95-4fb3-b90e-d593e28f2ad4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:39.241229 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ab0d8e1-eb95-4fb3-b90e-d593e28f2ad4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:39.241714 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ab0d8e1-eb95-4fb3-b90e-d593e28f2ad4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:39.242138 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-5ab0d8e1-eb95-4fb3-b90e-d593e28f2ad4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:39.373773 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-5ab0d8e1-eb95-4fb3-b90e-d593e28f2ad4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:39.381346 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-5ab0d8e1-eb95-4fb3-b90e-d593e28f2ad4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1266 microversion: 2.1 time: 0.153091 Oct 14 13:09:39.381942 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 480/955] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:39 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:40.404999 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-00f0039c-e502-4e4b-9ec7-b04b0dcaa873 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:40.405662 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-00f0039c-e502-4e4b-9ec7-b04b0dcaa873 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:40.412121 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00f0039c-e502-4e4b-9ec7-b04b0dcaa873 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:40.412593 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00f0039c-e502-4e4b-9ec7-b04b0dcaa873 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:40.413053 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00f0039c-e502-4e4b-9ec7-b04b0dcaa873 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:40.413760 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00f0039c-e502-4e4b-9ec7-b04b0dcaa873 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:40.414207 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00f0039c-e502-4e4b-9ec7-b04b0dcaa873 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:40.414624 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-00f0039c-e502-4e4b-9ec7-b04b0dcaa873 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:40.482012 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:40.503648 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=6 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:40.551987 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-00f0039c-e502-4e4b-9ec7-b04b0dcaa873 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:40.559647 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-00f0039c-e502-4e4b-9ec7-b04b0dcaa873 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1266 microversion: 2.1 time: 0.158702 Oct 14 13:09:40.560201 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 476/956] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:40 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:41.581987 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-095cfa43-c40c-427d-9fae-f6ce9b04ce3c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:41.582597 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-095cfa43-c40c-427d-9fae-f6ce9b04ce3c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:41.585029 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=2 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:09:41.591890 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-095cfa43-c40c-427d-9fae-f6ce9b04ce3c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:41.592378 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-095cfa43-c40c-427d-9fae-f6ce9b04ce3c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:41.592830 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-095cfa43-c40c-427d-9fae-f6ce9b04ce3c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:41.593539 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-095cfa43-c40c-427d-9fae-f6ce9b04ce3c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:41.593996 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-095cfa43-c40c-427d-9fae-f6ce9b04ce3c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:41.594529 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-095cfa43-c40c-427d-9fae-f6ce9b04ce3c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:41.733218 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-095cfa43-c40c-427d-9fae-f6ce9b04ce3c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:41.741681 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-095cfa43-c40c-427d-9fae-f6ce9b04ce3c tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1266 microversion: 2.1 time: 0.163596 Oct 14 13:09:41.742247 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 481/957] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:41 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:42.765769 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-83ef9fee-47b7-4c08-9866-3c3bd2f8110a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:42.766367 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-83ef9fee-47b7-4c08-9866-3c3bd2f8110a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:42.773115 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-83ef9fee-47b7-4c08-9866-3c3bd2f8110a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:42.773638 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-83ef9fee-47b7-4c08-9866-3c3bd2f8110a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:42.774080 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-83ef9fee-47b7-4c08-9866-3c3bd2f8110a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:42.774771 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-83ef9fee-47b7-4c08-9866-3c3bd2f8110a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:42.775226 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-83ef9fee-47b7-4c08-9866-3c3bd2f8110a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:42.775649 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-83ef9fee-47b7-4c08-9866-3c3bd2f8110a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:42.904537 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-83ef9fee-47b7-4c08-9866-3c3bd2f8110a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:42.912344 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-83ef9fee-47b7-4c08-9866-3c3bd2f8110a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1266 microversion: 2.1 time: 0.150497 Oct 14 13:09:42.913021 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 477/958] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:42 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:43.935595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-e10df01d-c169-40d1-900e-1917bdce586e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:43.936259 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-e10df01d-c169-40d1-900e-1917bdce586e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:43.942674 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e10df01d-c169-40d1-900e-1917bdce586e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:43.943156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e10df01d-c169-40d1-900e-1917bdce586e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:43.943589 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e10df01d-c169-40d1-900e-1917bdce586e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:43.944273 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e10df01d-c169-40d1-900e-1917bdce586e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:43.944718 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e10df01d-c169-40d1-900e-1917bdce586e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:43.945136 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-e10df01d-c169-40d1-900e-1917bdce586e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:44.075160 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-e10df01d-c169-40d1-900e-1917bdce586e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:44.082773 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-e10df01d-c169-40d1-900e-1917bdce586e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1266 microversion: 2.1 time: 0.151818 Oct 14 13:09:44.083329 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 482/959] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:43 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:45.106150 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-cccecabd-fb71-40c6-97ce-868ddc7b165a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:45.106756 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-cccecabd-fb71-40c6-97ce-868ddc7b165a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:45.113467 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cccecabd-fb71-40c6-97ce-868ddc7b165a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:45.113978 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cccecabd-fb71-40c6-97ce-868ddc7b165a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:45.114407 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cccecabd-fb71-40c6-97ce-868ddc7b165a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:45.115090 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cccecabd-fb71-40c6-97ce-868ddc7b165a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:45.115560 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cccecabd-fb71-40c6-97ce-868ddc7b165a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:45.115988 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-cccecabd-fb71-40c6-97ce-868ddc7b165a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:45.250313 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-cccecabd-fb71-40c6-97ce-868ddc7b165a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:45.258394 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-cccecabd-fb71-40c6-97ce-868ddc7b165a tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1266 microversion: 2.1 time: 0.156564 Oct 14 13:09:45.259124 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 478/960] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:45 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:45.374343 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-01e6cd36-097e-4cd2-ad12-af1c732bdc6e req-1654a31d-c336-487c-b541-7b71e0aaf2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddac68fe-a256-4b03-9006-f69520b2973b", "name": "network-vif-plugged", "status": "completed", "tag": "49af9af5-59c3-46e1-a7eb-12e6f6097a1b"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:09:45.384525 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-01e6cd36-097e-4cd2-ad12-af1c732bdc6e req-1654a31d-c336-487c-b541-7b71e0aaf2f8 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:45.385007 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-01e6cd36-097e-4cd2-ad12-af1c732bdc6e req-1654a31d-c336-487c-b541-7b71e0aaf2f8 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:45.385618 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-01e6cd36-097e-4cd2-ad12-af1c732bdc6e req-1654a31d-c336-487c-b541-7b71e0aaf2f8 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:45.396899 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-01e6cd36-097e-4cd2-ad12-af1c732bdc6e req-1654a31d-c336-487c-b541-7b71e0aaf2f8 service nova] Creating event network-vif-plugged:49af9af5-59c3-46e1-a7eb-12e6f6097a1b for instance ddac68fe-a256-4b03-9006-f69520b2973b on hv-cinder-82099 Oct 14 13:09:45.402129 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-01e6cd36-097e-4cd2-ad12-af1c732bdc6e req-1654a31d-c336-487c-b541-7b71e0aaf2f8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032330 Oct 14 13:09:45.402900 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 483/961] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:09:46.280542 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-5da746df-4e4c-40bb-a6a0-b2383cec7aeb tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:46.281095 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-5da746df-4e4c-40bb-a6a0-b2383cec7aeb tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:46.287534 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5da746df-4e4c-40bb-a6a0-b2383cec7aeb tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:46.288051 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5da746df-4e4c-40bb-a6a0-b2383cec7aeb tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:46.288486 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5da746df-4e4c-40bb-a6a0-b2383cec7aeb tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:46.289171 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5da746df-4e4c-40bb-a6a0-b2383cec7aeb tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:46.289650 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5da746df-4e4c-40bb-a6a0-b2383cec7aeb tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:46.290083 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-5da746df-4e4c-40bb-a6a0-b2383cec7aeb tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:46.418397 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-5da746df-4e4c-40bb-a6a0-b2383cec7aeb tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:46.425984 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-5da746df-4e4c-40bb-a6a0-b2383cec7aeb tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1266 microversion: 2.1 time: 0.149316 Oct 14 13:09:46.426570 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 479/962] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:46 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:47.449821 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-21e9a234-b61d-4eaf-a038-7ae4dfcbdc05 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:47.450530 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-21e9a234-b61d-4eaf-a038-7ae4dfcbdc05 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:47.456648 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21e9a234-b61d-4eaf-a038-7ae4dfcbdc05 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:47.457133 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21e9a234-b61d-4eaf-a038-7ae4dfcbdc05 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:47.457601 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21e9a234-b61d-4eaf-a038-7ae4dfcbdc05 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:47.458290 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21e9a234-b61d-4eaf-a038-7ae4dfcbdc05 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:47.458747 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21e9a234-b61d-4eaf-a038-7ae4dfcbdc05 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:47.459175 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21e9a234-b61d-4eaf-a038-7ae4dfcbdc05 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:47.587094 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-21e9a234-b61d-4eaf-a038-7ae4dfcbdc05 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:47.595270 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-21e9a234-b61d-4eaf-a038-7ae4dfcbdc05 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1266 microversion: 2.1 time: 0.150751 Oct 14 13:09:47.595838 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 484/963] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:47 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:48.618036 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ba954ba4-d5b9-45b0-9d98-6f5e6843a514 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:48.619422 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-ba954ba4-d5b9-45b0-9d98-6f5e6843a514 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:48.625867 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ba954ba4-d5b9-45b0-9d98-6f5e6843a514 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:48.626353 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ba954ba4-d5b9-45b0-9d98-6f5e6843a514 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:48.626788 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ba954ba4-d5b9-45b0-9d98-6f5e6843a514 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:48.627477 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ba954ba4-d5b9-45b0-9d98-6f5e6843a514 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:48.627931 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ba954ba4-d5b9-45b0-9d98-6f5e6843a514 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:48.628348 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-ba954ba4-d5b9-45b0-9d98-6f5e6843a514 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:48.760591 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-ba954ba4-d5b9-45b0-9d98-6f5e6843a514 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:48.768927 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ba954ba4-d5b9-45b0-9d98-6f5e6843a514 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1266 microversion: 2.1 time: 0.154686 Oct 14 13:09:48.769510 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 480/964] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:48 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:49.791656 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-4721e09b-0316-4b11-a589-e035f4d42310 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:49.792359 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-4721e09b-0316-4b11-a589-e035f4d42310 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:49.798796 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4721e09b-0316-4b11-a589-e035f4d42310 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:49.799285 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4721e09b-0316-4b11-a589-e035f4d42310 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:49.799725 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4721e09b-0316-4b11-a589-e035f4d42310 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:49.800495 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4721e09b-0316-4b11-a589-e035f4d42310 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:49.800956 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4721e09b-0316-4b11-a589-e035f4d42310 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:49.801385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-4721e09b-0316-4b11-a589-e035f4d42310 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:49.938361 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-4721e09b-0316-4b11-a589-e035f4d42310 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:49.946104 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-4721e09b-0316-4b11-a589-e035f4d42310 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1452 microversion: 2.1 time: 0.158559 Oct 14 13:09:49.946795 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 485/965] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:49 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:49.971288 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-b32fd385-9731-4fb9-a34b-a0f4b1e95d81 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:09:49.971904 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-b32fd385-9731-4fb9-a34b-a0f4b1e95d81 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:09:49.978851 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b32fd385-9731-4fb9-a34b-a0f4b1e95d81 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:49.979338 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b32fd385-9731-4fb9-a34b-a0f4b1e95d81 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:49.980007 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b32fd385-9731-4fb9-a34b-a0f4b1e95d81 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:49.980883 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b32fd385-9731-4fb9-a34b-a0f4b1e95d81 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:49.982136 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b32fd385-9731-4fb9-a34b-a0f4b1e95d81 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:49.982565 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b32fd385-9731-4fb9-a34b-a0f4b1e95d81 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:50.121871 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-b32fd385-9731-4fb9-a34b-a0f4b1e95d81 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:09:50.129512 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-b32fd385-9731-4fb9-a34b-a0f4b1e95d81 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1452 microversion: 2.1 time: 0.162222 Oct 14 13:09:50.130087 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 481/966] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:09:49 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:09:52.340205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-9edf2444-d982-42be-a8f7-8c2c443a8f8a req-e179feca-2ab6-491f-8038-f8f69f7b2ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddac68fe-a256-4b03-9006-f69520b2973b", "tag": "49af9af5-59c3-46e1-a7eb-12e6f6097a1b"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:09:52.351058 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-9edf2444-d982-42be-a8f7-8c2c443a8f8a req-e179feca-2ab6-491f-8038-f8f69f7b2ade service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:09:52.352030 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-9edf2444-d982-42be-a8f7-8c2c443a8f8a req-e179feca-2ab6-491f-8038-f8f69f7b2ade service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:09:52.352939 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-9edf2444-d982-42be-a8f7-8c2c443a8f8a req-e179feca-2ab6-491f-8038-f8f69f7b2ade service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:09:52.370100 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-9edf2444-d982-42be-a8f7-8c2c443a8f8a req-e179feca-2ab6-491f-8038-f8f69f7b2ade service nova] Creating event network-changed:49af9af5-59c3-46e1-a7eb-12e6f6097a1b for instance ddac68fe-a256-4b03-9006-f69520b2973b on hv-cinder-82099 Oct 14 13:09:52.378631 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-9edf2444-d982-42be-a8f7-8c2c443a8f8a req-e179feca-2ab6-491f-8038-f8f69f7b2ade service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042335 Oct 14 13:09:52.379436 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 486/967] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:11:47.525646 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:47.526393 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:47.527714 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 14 13:11:47.527858 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Fri Oct 14 13:11:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b (ip 10.222.0.47) !!! Oct 14 13:11:47.534655 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-bab46c61-24c6-49f9-a159-c5248dd24b9b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:11:47.535137 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-bab46c61-24c6-49f9-a159-c5248dd24b9b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:11:47.546649 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bab46c61-24c6-49f9-a159-c5248dd24b9b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:47.547126 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bab46c61-24c6-49f9-a159-c5248dd24b9b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:47.547553 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bab46c61-24c6-49f9-a159-c5248dd24b9b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:47.548239 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bab46c61-24c6-49f9-a159-c5248dd24b9b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:47.548692 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bab46c61-24c6-49f9-a159-c5248dd24b9b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:47.549109 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bab46c61-24c6-49f9-a159-c5248dd24b9b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:47.575814 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-bab46c61-24c6-49f9-a159-c5248dd24b9b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Going to try to terminate instance {{(pid=118869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:11:47.648130 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-bab46c61-24c6-49f9-a159-c5248dd24b9b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 204 len: 0 microversion: 2.1 time: 0.123821 Oct 14 13:11:47.648812 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 482/968] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:11:47 2022] DELETE /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:11:47.655031 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d1d307de-5e74-41ce-b97f-b0896b5110c0] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 14 13:11:47.655620 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=30 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:47.656402 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:11:47.657497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 14 13:11:47.657640 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Fri Oct 14 13:11:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b (ip 10.222.0.47) !!! Oct 14 13:11:47.659345 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 14 13:11:47.665369 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-84aac2ee-11c4-4137-8492-816c6baa30ff tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:11:47.666096 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-84aac2ee-11c4-4137-8492-816c6baa30ff tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:11:47.675753 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-84aac2ee-11c4-4137-8492-816c6baa30ff tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:47.676235 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-84aac2ee-11c4-4137-8492-816c6baa30ff tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:47.677235 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-84aac2ee-11c4-4137-8492-816c6baa30ff tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:47.677960 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-84aac2ee-11c4-4137-8492-816c6baa30ff tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:47.678416 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-84aac2ee-11c4-4137-8492-816c6baa30ff tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:47.678841 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-84aac2ee-11c4-4137-8492-816c6baa30ff tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:47.813072 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-84aac2ee-11c4-4137-8492-816c6baa30ff tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:11:47.820761 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-84aac2ee-11c4-4137-8492-816c6baa30ff tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1577 microversion: 2.1 time: 0.167540 Oct 14 13:11:47.821311 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 487/969] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:11:47 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:11:48.845145 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-916c5358-bc6c-4c45-ba87-23cad406c1d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:11:48.845866 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-916c5358-bc6c-4c45-ba87-23cad406c1d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:11:48.852402 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-916c5358-bc6c-4c45-ba87-23cad406c1d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:48.852884 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-916c5358-bc6c-4c45-ba87-23cad406c1d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:48.853316 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-916c5358-bc6c-4c45-ba87-23cad406c1d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:48.854038 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-916c5358-bc6c-4c45-ba87-23cad406c1d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:48.854484 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-916c5358-bc6c-4c45-ba87-23cad406c1d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:48.854905 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-916c5358-bc6c-4c45-ba87-23cad406c1d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:48.992680 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-916c5358-bc6c-4c45-ba87-23cad406c1d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:11:49.000594 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-916c5358-bc6c-4c45-ba87-23cad406c1d8 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1577 microversion: 2.1 time: 0.159675 Oct 14 13:11:49.001151 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 483/970] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:11:48 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:11:49.952164 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO oslo.messaging._drivers.impl_rabbit [-] [d1d307de-5e74-41ce-b97f-b0896b5110c0] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 52950. Oct 14 13:11:50.024581 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-1fba5fc7-1681-401e-941b-948514af4e22 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:11:50.025944 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-1fba5fc7-1681-401e-941b-948514af4e22 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:11:50.034678 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1fba5fc7-1681-401e-941b-948514af4e22 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:50.035502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1fba5fc7-1681-401e-941b-948514af4e22 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:50.036506 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1fba5fc7-1681-401e-941b-948514af4e22 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:50.037456 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1fba5fc7-1681-401e-941b-948514af4e22 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:50.038853 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1fba5fc7-1681-401e-941b-948514af4e22 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:50.039537 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1fba5fc7-1681-401e-941b-948514af4e22 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:50.084277 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-359cca13-ce1f-4ea0-976e-c9df5eb5fe03 req-5c61d92a-42f7-4c7e-8554-73c7f2e7ac78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddac68fe-a256-4b03-9006-f69520b2973b", "name": "network-vif-deleted", "tag": "49af9af5-59c3-46e1-a7eb-12e6f6097a1b"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:11:50.099293 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-359cca13-ce1f-4ea0-976e-c9df5eb5fe03 req-5c61d92a-42f7-4c7e-8554-73c7f2e7ac78 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:50.099828 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-359cca13-ce1f-4ea0-976e-c9df5eb5fe03 req-5c61d92a-42f7-4c7e-8554-73c7f2e7ac78 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:50.100277 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-359cca13-ce1f-4ea0-976e-c9df5eb5fe03 req-5c61d92a-42f7-4c7e-8554-73c7f2e7ac78 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:50.108013 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-1fba5fc7-1681-401e-941b-948514af4e22 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:11:50.116429 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-359cca13-ce1f-4ea0-976e-c9df5eb5fe03 req-5c61d92a-42f7-4c7e-8554-73c7f2e7ac78 service nova] Creating event network-vif-deleted:49af9af5-59c3-46e1-a7eb-12e6f6097a1b for instance ddac68fe-a256-4b03-9006-f69520b2973b on hv-cinder-82099 Oct 14 13:11:50.120766 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-1fba5fc7-1681-401e-941b-948514af4e22 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 200 len: 1225 microversion: 2.1 time: 0.101117 Oct 14 13:11:50.124261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-359cca13-ce1f-4ea0-976e-c9df5eb5fe03 req-5c61d92a-42f7-4c7e-8554-73c7f2e7ac78 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188297 Oct 14 13:11:50.131038 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 488/971] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:11:50.131612 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 484/972] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:11:50 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:11:51.146913 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-59fb0f96-da87-4772-872c-c334469c8157 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:11:51.147539 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-59fb0f96-da87-4772-872c-c334469c8157 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:11:51.153667 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-59fb0f96-da87-4772-872c-c334469c8157 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:51.154149 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-59fb0f96-da87-4772-872c-c334469c8157 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:51.154579 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-59fb0f96-da87-4772-872c-c334469c8157 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:51.155253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-59fb0f96-da87-4772-872c-c334469c8157 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:51.155701 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-59fb0f96-da87-4772-872c-c334469c8157 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:51.156122 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-59fb0f96-da87-4772-872c-c334469c8157 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:51.169199 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-59fb0f96-da87-4772-872c-c334469c8157 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] HTTP exception thrown: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-59fb0f96-da87-4772-872c-c334469c8157 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Request method failure captured: Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b HTTP/1.1 Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV9vLGes1jz82OvBjjUKnzUwn8Z09B3gJr5w62fHHppF5nItx3e4ySuP2Ly7DdyoctQqzUUWn6k0fkttypZAxb8jMh-Pef-GfpVg7Ur3hLBW-4ezP25gEtSYdBurd4XVW0itSKNzsPNEdgh13mRfTsbi362MV767QSj2m7M0dd2Nwaw Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: d5a0e78a09a843b1b6d2eee3ed8f7903 Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-TestVolumeBootPattern-1888630407 Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:11:51.170869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:11:51.172665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d5a0e78a09a843b1b6d2eee3ed8f7903"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d5a0e78a09a843b1b6d2eee3ed8f7903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d5a0e78a09a843b1b6d2eee3ed8f7903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d5a0e78a09a843b1b6d2eee3ed8f7903", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:11:51.172665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-TestVolumeBootPattern-1888630407 Oct 14 13:11:51.172665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: d5a0e78a09a843b1b6d2eee3ed8f7903 Oct 14 13:11:51.172665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888630407 Oct 14 13:11:51.172665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-TestVolumeBootPattern-1888630407-project Oct 14 13:11:51.172665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:11:51.172665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:11:51.172665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 159c0ca7e417485b8ae497301a669228 Oct 14 13:11:51.172665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-TestVolumeBootPattern-1888630407-project Oct 14 13:11:51.172665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:11:51.172665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. Oct 14 13:11:51.172665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': 'ddac68fe-a256-4b03-9006-f69520b2973b'} Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:11:51.173595 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. Oct 14 13:11:51.175088 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:11:51.176367 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-59fb0f96-da87-4772-872c-c334469c8157 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Returning 404 to user: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:11:51.176367 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-59fb0f96-da87-4772-872c-c334469c8157 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 404 len: 111 microversion: 2.1 time: 0.030747 Oct 14 13:11:51.176367 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 489/973] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:11:51 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:11:51.266143 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1893729109", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1372720141", "security_groups": [{"name": "tempest-secgroup-smoke-1445989676"}], "block_device_mapping_v2": [{"uuid": "5e027f44-5c1c-4d64-8ad8-c0b058579c0c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8eba902a-eded-44ab-9171-f5f12325a82d"}]}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:11:51.378814 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.network.neutron [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] validate_networks() for [('8eba902a-eded-44ab-9171-f5f12325a82d', None, None, None, None, None)] {{(pid=118869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:11:51.795419 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Flavor limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:11:51.795875 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Image limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:11:51.796345 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Flavor pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:11:51.796750 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Image pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:11:51.797155 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:11:51.805803 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:51.806279 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:51.806714 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:51.807428 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:51.807876 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:51.808294 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:51.824572 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Getting quotas for project d5a0e78a09a843b1b6d2eee3ed8f7903. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:11:51.828444 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Getting quotas for user 159c0ca7e417485b8ae497301a669228 and project d5a0e78a09a843b1b6d2eee3ed8f7903. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:11:51.884907 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Going to run 1 instances... {{(pid=118869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:11:51.887107 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e027f44-5c1c-4d64-8ad8-c0b058579c0c',volume_size=None,volume_type=None)] {{(pid=118869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:11:52.013049 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-f57966c1-148f-42f6-8933-5ee0fd06f11e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.750633 Oct 14 13:11:52.013634 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 485/974] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:11:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 13:11:52.025937 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-22b8f099-e562-4463-8515-bc0620e71c0e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:11:52.026701 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-22b8f099-e562-4463-8515-bc0620e71c0e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:11:52.080844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-22b8f099-e562-4463-8515-bc0620e71c0e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:11:52.088742 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-22b8f099-e562-4463-8515-bc0620e71c0e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1095 microversion: 2.1 time: 0.066743 Oct 14 13:11:52.089301 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 490/975] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:11:52 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:11:53.113745 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-1ffe9e94-c18a-42b6-9e52-062f0d00bc29 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:11:53.114660 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-1ffe9e94-c18a-42b6-9e52-062f0d00bc29 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:11:53.122104 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1ffe9e94-c18a-42b6-9e52-062f0d00bc29 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:53.122601 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1ffe9e94-c18a-42b6-9e52-062f0d00bc29 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:53.123626 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1ffe9e94-c18a-42b6-9e52-062f0d00bc29 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:53.124000 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1ffe9e94-c18a-42b6-9e52-062f0d00bc29 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:53.124464 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1ffe9e94-c18a-42b6-9e52-062f0d00bc29 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:53.124959 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-1ffe9e94-c18a-42b6-9e52-062f0d00bc29 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:53.188614 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-1ffe9e94-c18a-42b6-9e52-062f0d00bc29 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:11:53.196806 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-1ffe9e94-c18a-42b6-9e52-062f0d00bc29 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1211 microversion: 2.1 time: 0.089477 Oct 14 13:11:53.197693 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 486/976] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:11:53 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:11:54.220467 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-9b82496d-c13e-4f89-bf45-9d798f72182d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:11:54.221083 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-9b82496d-c13e-4f89-bf45-9d798f72182d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:11:54.229688 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9b82496d-c13e-4f89-bf45-9d798f72182d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:54.230182 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9b82496d-c13e-4f89-bf45-9d798f72182d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:54.230625 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9b82496d-c13e-4f89-bf45-9d798f72182d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:54.231334 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9b82496d-c13e-4f89-bf45-9d798f72182d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:54.231790 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9b82496d-c13e-4f89-bf45-9d798f72182d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:54.232214 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-9b82496d-c13e-4f89-bf45-9d798f72182d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:54.439772 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-9b82496d-c13e-4f89-bf45-9d798f72182d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:11:54.447496 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-9b82496d-c13e-4f89-bf45-9d798f72182d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1267 microversion: 2.1 time: 0.231115 Oct 14 13:11:54.448255 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 491/977] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:11:54 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:11:54.516606 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-534bb7a6-7803-412f-9760-d4820692b280 req-462afcfc-d294-4c7d-b914-748435a6f812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e20aba6-91ca-4787-b9dd-e2ac66f64bb1", "tag": "e0f9e62d-5a73-49b3-a2fb-730386480046"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:11:54.528310 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-534bb7a6-7803-412f-9760-d4820692b280 req-462afcfc-d294-4c7d-b914-748435a6f812 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:54.528874 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-534bb7a6-7803-412f-9760-d4820692b280 req-462afcfc-d294-4c7d-b914-748435a6f812 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:54.529972 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-534bb7a6-7803-412f-9760-d4820692b280 req-462afcfc-d294-4c7d-b914-748435a6f812 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:54.542589 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-534bb7a6-7803-412f-9760-d4820692b280 req-462afcfc-d294-4c7d-b914-748435a6f812 service nova] Creating event network-changed:e0f9e62d-5a73-49b3-a2fb-730386480046 for instance 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 on hv-cinder-82099 Oct 14 13:11:54.547940 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-534bb7a6-7803-412f-9760-d4820692b280 req-462afcfc-d294-4c7d-b914-748435a6f812 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035615 Oct 14 13:11:54.548640 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 487/978] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:11:55.470551 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-58d4907e-d9af-4881-ab1a-2ac309e7df33 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:11:55.471194 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-58d4907e-d9af-4881-ab1a-2ac309e7df33 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:11:55.477835 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-58d4907e-d9af-4881-ab1a-2ac309e7df33 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:55.478334 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-58d4907e-d9af-4881-ab1a-2ac309e7df33 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:55.478773 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-58d4907e-d9af-4881-ab1a-2ac309e7df33 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:55.479468 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-58d4907e-d9af-4881-ab1a-2ac309e7df33 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:55.479926 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-58d4907e-d9af-4881-ab1a-2ac309e7df33 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:55.480355 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-58d4907e-d9af-4881-ab1a-2ac309e7df33 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:55.674309 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-58d4907e-d9af-4881-ab1a-2ac309e7df33 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:11:55.682856 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-58d4907e-d9af-4881-ab1a-2ac309e7df33 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1267 microversion: 2.1 time: 0.216407 Oct 14 13:11:55.683439 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 492/979] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:11:55 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:11:56.706222 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-fc4ad9a8-604a-4152-b314-910672437d87 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:11:56.706909 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-fc4ad9a8-604a-4152-b314-910672437d87 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:11:56.713620 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc4ad9a8-604a-4152-b314-910672437d87 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:56.714091 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc4ad9a8-604a-4152-b314-910672437d87 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:56.714519 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc4ad9a8-604a-4152-b314-910672437d87 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:56.715196 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc4ad9a8-604a-4152-b314-910672437d87 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:56.715648 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc4ad9a8-604a-4152-b314-910672437d87 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:56.716065 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fc4ad9a8-604a-4152-b314-910672437d87 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:56.848962 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-fc4ad9a8-604a-4152-b314-910672437d87 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:11:56.856609 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-fc4ad9a8-604a-4152-b314-910672437d87 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1267 microversion: 2.1 time: 0.155172 Oct 14 13:11:56.857163 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 488/980] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:11:56 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:11:57.879572 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-d0b6761d-d97a-4fd0-bbbc-53e2dd893604 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:11:57.880697 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-d0b6761d-d97a-4fd0-bbbc-53e2dd893604 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:11:57.887135 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0b6761d-d97a-4fd0-bbbc-53e2dd893604 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:57.887620 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0b6761d-d97a-4fd0-bbbc-53e2dd893604 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:57.888053 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0b6761d-d97a-4fd0-bbbc-53e2dd893604 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:57.888736 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0b6761d-d97a-4fd0-bbbc-53e2dd893604 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:57.889187 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0b6761d-d97a-4fd0-bbbc-53e2dd893604 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:57.889649 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-d0b6761d-d97a-4fd0-bbbc-53e2dd893604 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:58.019156 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-d0b6761d-d97a-4fd0-bbbc-53e2dd893604 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:11:58.026894 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-d0b6761d-d97a-4fd0-bbbc-53e2dd893604 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1267 microversion: 2.1 time: 0.151228 Oct 14 13:11:58.027457 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 493/981] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:11:57 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:11:59.049109 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-595d7a71-98e7-403c-838a-00fe423415db tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:11:59.049735 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-595d7a71-98e7-403c-838a-00fe423415db tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:11:59.056160 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-595d7a71-98e7-403c-838a-00fe423415db tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:59.056637 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-595d7a71-98e7-403c-838a-00fe423415db tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:59.057086 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-595d7a71-98e7-403c-838a-00fe423415db tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:59.057798 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-595d7a71-98e7-403c-838a-00fe423415db tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:11:59.058244 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-595d7a71-98e7-403c-838a-00fe423415db tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:11:59.058659 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-595d7a71-98e7-403c-838a-00fe423415db tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:11:59.188788 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-595d7a71-98e7-403c-838a-00fe423415db tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:11:59.197075 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-595d7a71-98e7-403c-838a-00fe423415db tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1267 microversion: 2.1 time: 0.151800 Oct 14 13:11:59.197663 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 489/982] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:11:59 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:12:00.219887 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-98801c51-1b77-4b49-aade-155412e81621 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:12:00.220500 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-98801c51-1b77-4b49-aade-155412e81621 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:12:00.227096 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-98801c51-1b77-4b49-aade-155412e81621 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:00.227575 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-98801c51-1b77-4b49-aade-155412e81621 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:00.228006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-98801c51-1b77-4b49-aade-155412e81621 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:00.228684 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-98801c51-1b77-4b49-aade-155412e81621 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:00.229130 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-98801c51-1b77-4b49-aade-155412e81621 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:00.229581 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-98801c51-1b77-4b49-aade-155412e81621 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:00.361248 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-98801c51-1b77-4b49-aade-155412e81621 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:12:00.369624 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-98801c51-1b77-4b49-aade-155412e81621 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1267 microversion: 2.1 time: 0.153575 Oct 14 13:12:00.370186 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 494/983] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:12:00 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:12:01.392216 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-77204b7c-c16f-42ea-bee5-65c5b64116c6 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:12:01.392834 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-77204b7c-c16f-42ea-bee5-65c5b64116c6 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:12:01.399256 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-77204b7c-c16f-42ea-bee5-65c5b64116c6 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:01.399727 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-77204b7c-c16f-42ea-bee5-65c5b64116c6 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:01.400149 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-77204b7c-c16f-42ea-bee5-65c5b64116c6 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:01.400846 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-77204b7c-c16f-42ea-bee5-65c5b64116c6 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:01.401296 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-77204b7c-c16f-42ea-bee5-65c5b64116c6 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:01.401739 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-77204b7c-c16f-42ea-bee5-65c5b64116c6 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:01.530877 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-77204b7c-c16f-42ea-bee5-65c5b64116c6 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:12:01.539330 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-77204b7c-c16f-42ea-bee5-65c5b64116c6 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1267 microversion: 2.1 time: 0.150862 Oct 14 13:12:01.539900 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 490/984] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:12:01 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:12:02.562971 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-584ba89f-758d-40aa-8f29-aca89a3d8979 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:12:02.563586 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-584ba89f-758d-40aa-8f29-aca89a3d8979 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:12:02.566001 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=2 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:12:02.572119 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-584ba89f-758d-40aa-8f29-aca89a3d8979 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:02.572626 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-584ba89f-758d-40aa-8f29-aca89a3d8979 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:02.573061 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-584ba89f-758d-40aa-8f29-aca89a3d8979 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:02.573775 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-584ba89f-758d-40aa-8f29-aca89a3d8979 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:02.574226 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-584ba89f-758d-40aa-8f29-aca89a3d8979 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:02.574645 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-584ba89f-758d-40aa-8f29-aca89a3d8979 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:02.704253 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-584ba89f-758d-40aa-8f29-aca89a3d8979 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:12:02.712165 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-584ba89f-758d-40aa-8f29-aca89a3d8979 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1267 microversion: 2.1 time: 0.153046 Oct 14 13:12:02.712723 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 495/985] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:12:02 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:12:03.734144 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-24646058-bee5-46d1-9aac-94809b46dff3 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:12:03.734685 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-24646058-bee5-46d1-9aac-94809b46dff3 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:12:03.736613 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:12:03.737276 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=6 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:12:03.744143 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-24646058-bee5-46d1-9aac-94809b46dff3 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:03.744626 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-24646058-bee5-46d1-9aac-94809b46dff3 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:03.745059 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-24646058-bee5-46d1-9aac-94809b46dff3 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:03.745774 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-24646058-bee5-46d1-9aac-94809b46dff3 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:03.746225 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-24646058-bee5-46d1-9aac-94809b46dff3 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:03.746647 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-24646058-bee5-46d1-9aac-94809b46dff3 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:03.880082 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-24646058-bee5-46d1-9aac-94809b46dff3 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:12:03.888347 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-24646058-bee5-46d1-9aac-94809b46dff3 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1267 microversion: 2.1 time: 0.158511 Oct 14 13:12:03.888908 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 491/986] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:12:03 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:12:04.044773 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-0bf034bc-2bd1-4186-872d-2aa454bd75cf req-c49ad04e-3969-4ab3-b97f-20f50fc956fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e20aba6-91ca-4787-b9dd-e2ac66f64bb1", "name": "network-vif-plugged", "status": "completed", "tag": "e0f9e62d-5a73-49b3-a2fb-730386480046"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:12:04.055360 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-0bf034bc-2bd1-4186-872d-2aa454bd75cf req-c49ad04e-3969-4ab3-b97f-20f50fc956fd service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:04.055967 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-0bf034bc-2bd1-4186-872d-2aa454bd75cf req-c49ad04e-3969-4ab3-b97f-20f50fc956fd service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:04.056395 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-0bf034bc-2bd1-4186-872d-2aa454bd75cf req-c49ad04e-3969-4ab3-b97f-20f50fc956fd service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:04.067393 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-0bf034bc-2bd1-4186-872d-2aa454bd75cf req-c49ad04e-3969-4ab3-b97f-20f50fc956fd service nova] Creating event network-vif-plugged:e0f9e62d-5a73-49b3-a2fb-730386480046 for instance 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 on hv-cinder-82099 Oct 14 13:12:04.073105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-0bf034bc-2bd1-4186-872d-2aa454bd75cf req-c49ad04e-3969-4ab3-b97f-20f50fc956fd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090267 Oct 14 13:12:04.073733 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 496/987] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:12:04.911290 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-9de9d9f6-f102-4735-a24e-4a79ac70492d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:12:04.911900 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-9de9d9f6-f102-4735-a24e-4a79ac70492d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:12:04.919007 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9de9d9f6-f102-4735-a24e-4a79ac70492d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:04.919492 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9de9d9f6-f102-4735-a24e-4a79ac70492d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:04.919929 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9de9d9f6-f102-4735-a24e-4a79ac70492d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:04.920624 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9de9d9f6-f102-4735-a24e-4a79ac70492d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:04.921080 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9de9d9f6-f102-4735-a24e-4a79ac70492d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:04.921524 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-9de9d9f6-f102-4735-a24e-4a79ac70492d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:05.049848 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-9de9d9f6-f102-4735-a24e-4a79ac70492d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:12:05.057517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-9de9d9f6-f102-4735-a24e-4a79ac70492d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1267 microversion: 2.1 time: 0.150350 Oct 14 13:12:05.058088 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 492/988] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:12:04 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:12:06.081187 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-67220dd3-a227-472f-913d-a43bd4d1be38 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:12:06.081924 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-67220dd3-a227-472f-913d-a43bd4d1be38 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:12:06.089073 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-67220dd3-a227-472f-913d-a43bd4d1be38 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:06.089588 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-67220dd3-a227-472f-913d-a43bd4d1be38 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:06.090025 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-67220dd3-a227-472f-913d-a43bd4d1be38 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:06.090713 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-67220dd3-a227-472f-913d-a43bd4d1be38 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:06.091165 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-67220dd3-a227-472f-913d-a43bd4d1be38 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:06.091592 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-67220dd3-a227-472f-913d-a43bd4d1be38 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:06.230132 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-67220dd3-a227-472f-913d-a43bd4d1be38 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:12:06.238220 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-67220dd3-a227-472f-913d-a43bd4d1be38 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1453 microversion: 2.1 time: 0.161029 Oct 14 13:12:06.238731 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 497/989] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:12:06 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:12:06.260703 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-33864644-d996-4faa-8a56-76c7a1754845 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:12:06.261320 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-33864644-d996-4faa-8a56-76c7a1754845 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:12:06.267742 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-33864644-d996-4faa-8a56-76c7a1754845 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:06.268227 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-33864644-d996-4faa-8a56-76c7a1754845 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:06.268664 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-33864644-d996-4faa-8a56-76c7a1754845 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:06.269355 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-33864644-d996-4faa-8a56-76c7a1754845 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:06.269839 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-33864644-d996-4faa-8a56-76c7a1754845 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:06.270267 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-33864644-d996-4faa-8a56-76c7a1754845 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:06.403122 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-33864644-d996-4faa-8a56-76c7a1754845 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:12:06.410761 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-33864644-d996-4faa-8a56-76c7a1754845 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1453 microversion: 2.1 time: 0.154479 Oct 14 13:12:06.411321 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 493/990] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:12:06 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:12:07.949458 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-96fa526e-6bca-417b-b21c-7c2cfa61a9b4 req-1cc9a200-7062-4314-ad3a-f4a7c500ac2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e20aba6-91ca-4787-b9dd-e2ac66f64bb1", "tag": "e0f9e62d-5a73-49b3-a2fb-730386480046"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:12:07.959990 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-96fa526e-6bca-417b-b21c-7c2cfa61a9b4 req-1cc9a200-7062-4314-ad3a-f4a7c500ac2e service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:12:07.960556 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-96fa526e-6bca-417b-b21c-7c2cfa61a9b4 req-1cc9a200-7062-4314-ad3a-f4a7c500ac2e service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:12:07.961171 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-96fa526e-6bca-417b-b21c-7c2cfa61a9b4 req-1cc9a200-7062-4314-ad3a-f4a7c500ac2e service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:12:07.972173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-96fa526e-6bca-417b-b21c-7c2cfa61a9b4 req-1cc9a200-7062-4314-ad3a-f4a7c500ac2e service nova] Creating event network-changed:e0f9e62d-5a73-49b3-a2fb-730386480046 for instance 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 on hv-cinder-82099 Oct 14 13:12:07.978207 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-96fa526e-6bca-417b-b21c-7c2cfa61a9b4 req-1cc9a200-7062-4314-ad3a-f4a7c500ac2e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032544 Oct 14 13:12:07.978796 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 498/991] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:13:41.077383 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:41.078151 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:41.083726 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1559821127", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1372720141", "security_groups": [{"name": "tempest-secgroup-smoke-1445989676"}], "block_device_mapping_v2": [{"uuid": "c44c3720-d3fd-4b16-983c-70302940e7d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8eba902a-eded-44ab-9171-f5f12325a82d"}]}} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:13:41.198833 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.network.neutron [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] validate_networks() for [('8eba902a-eded-44ab-9171-f5f12325a82d', None, None, None, None, None)] {{(pid=118869) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 14 13:13:41.564478 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Flavor limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 14 13:13:41.564906 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Image limits 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 14 13:13:41.565370 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Flavor pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 14 13:13:41.565843 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Image pref 0:0:0 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 14 13:13:41.566248 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.virt.hardware [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118869) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 14 13:13:41.575384 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:41.575852 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:41.576283 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:41.576990 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:41.577432 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:41.577870 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:41.594901 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Getting quotas for project d5a0e78a09a843b1b6d2eee3ed8f7903. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 14 13:13:41.598818 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.quota [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Getting quotas for user 159c0ca7e417485b8ae497301a669228 and project d5a0e78a09a843b1b6d2eee3ed8f7903. Resources: {'instances', 'ram', 'cores'} {{(pid=118869) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 14 13:13:41.654336 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Going to run 1 instances... {{(pid=118869) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 14 13:13:41.657134 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c44c3720-d3fd-4b16-983c-70302940e7d0',volume_size=None,volume_type=None)] {{(pid=118869) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 14 13:13:41.784733 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c58183b3-a8d0-4184-a2e6-d3d5951afb91 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708929 Oct 14 13:13:41.785381 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 494/992] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Oct 14 13:13:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 14 13:13:41.794749 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=26 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:41.795906 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=50 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:41.801063 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-32ec0268-6b04-4456-bf0b-9c2193c83f86 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:41.801794 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-32ec0268-6b04-4456-bf0b-9c2193c83f86 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:41.856245 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-32ec0268-6b04-4456-bf0b-9c2193c83f86 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:41.863205 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-32ec0268-6b04-4456-bf0b-9c2193c83f86 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1095 microversion: 2.1 time: 0.070447 Oct 14 13:13:41.863770 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 499/993] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:41 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:13:42.886522 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-4fd2b38e-d05d-467b-bf99-c2b6e0f5b6e4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:42.887115 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-4fd2b38e-d05d-467b-bf99-c2b6e0f5b6e4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:42.894659 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4fd2b38e-d05d-467b-bf99-c2b6e0f5b6e4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:42.895416 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4fd2b38e-d05d-467b-bf99-c2b6e0f5b6e4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:42.896039 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4fd2b38e-d05d-467b-bf99-c2b6e0f5b6e4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:42.896737 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4fd2b38e-d05d-467b-bf99-c2b6e0f5b6e4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:42.897383 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4fd2b38e-d05d-467b-bf99-c2b6e0f5b6e4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:42.898019 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-4fd2b38e-d05d-467b-bf99-c2b6e0f5b6e4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:42.961807 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-4fd2b38e-d05d-467b-bf99-c2b6e0f5b6e4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:42.969931 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-4fd2b38e-d05d-467b-bf99-c2b6e0f5b6e4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1201 microversion: 2.1 time: 0.087753 Oct 14 13:13:42.970630 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 495/994] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:42 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1201 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 14 13:13:43.993897 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-454b5f53-848b-4725-86ab-8ee82448408b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:43.994519 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-454b5f53-848b-4725-86ab-8ee82448408b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:44.002043 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-454b5f53-848b-4725-86ab-8ee82448408b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:44.002532 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-454b5f53-848b-4725-86ab-8ee82448408b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:44.002968 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-454b5f53-848b-4725-86ab-8ee82448408b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:44.003670 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-454b5f53-848b-4725-86ab-8ee82448408b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:44.004126 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-454b5f53-848b-4725-86ab-8ee82448408b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:44.004553 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-454b5f53-848b-4725-86ab-8ee82448408b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:44.210792 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-454b5f53-848b-4725-86ab-8ee82448408b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:44.218622 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-454b5f53-848b-4725-86ab-8ee82448408b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1267 microversion: 2.1 time: 0.228928 Oct 14 13:13:44.219189 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 500/995] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:43 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:13:44.579500 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [req-c31c9619-07ed-4971-aa56-c1c5b751a65c req-5fdf2cda-ca12-4e69-ac0f-09d52b605643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3451be54-b4a6-4a64-b348-d8ba998900de", "tag": "1140c70c-36e4-4444-97d6-37c05e6cc3aa"}]} {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:13:44.592479 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-c31c9619-07ed-4971-aa56-c1c5b751a65c req-5fdf2cda-ca12-4e69-ac0f-09d52b605643 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:44.592986 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-c31c9619-07ed-4971-aa56-c1c5b751a65c req-5fdf2cda-ca12-4e69-ac0f-09d52b605643 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:44.593517 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [req-c31c9619-07ed-4971-aa56-c1c5b751a65c req-5fdf2cda-ca12-4e69-ac0f-09d52b605643 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:44.605672 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.compute.server_external_events [req-c31c9619-07ed-4971-aa56-c1c5b751a65c req-5fdf2cda-ca12-4e69-ac0f-09d52b605643 service nova] Creating event network-changed:1140c70c-36e4-4444-97d6-37c05e6cc3aa for instance 3451be54-b4a6-4a64-b348-d8ba998900de on hv-cinder-82099 Oct 14 13:13:44.611356 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [req-c31c9619-07ed-4971-aa56-c1c5b751a65c req-5fdf2cda-ca12-4e69-ac0f-09d52b605643 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035740 Oct 14 13:13:44.611949 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 496/996] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:13:45.242291 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-6fbe2a16-e3f4-46ab-8158-c3e30e081f25 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:45.242846 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-6fbe2a16-e3f4-46ab-8158-c3e30e081f25 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:45.249902 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6fbe2a16-e3f4-46ab-8158-c3e30e081f25 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:45.250385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6fbe2a16-e3f4-46ab-8158-c3e30e081f25 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:45.250813 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6fbe2a16-e3f4-46ab-8158-c3e30e081f25 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:45.251508 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6fbe2a16-e3f4-46ab-8158-c3e30e081f25 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:45.251957 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6fbe2a16-e3f4-46ab-8158-c3e30e081f25 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:45.252381 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-6fbe2a16-e3f4-46ab-8158-c3e30e081f25 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:45.455531 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-6fbe2a16-e3f4-46ab-8158-c3e30e081f25 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:45.463211 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-6fbe2a16-e3f4-46ab-8158-c3e30e081f25 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1267 microversion: 2.1 time: 0.225285 Oct 14 13:13:45.463774 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 501/997] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:45 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:13:46.486497 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-bc5b2ecc-062a-4883-b7db-9e01ecfd7212 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:46.487193 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-bc5b2ecc-062a-4883-b7db-9e01ecfd7212 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:46.494112 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bc5b2ecc-062a-4883-b7db-9e01ecfd7212 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:46.494585 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bc5b2ecc-062a-4883-b7db-9e01ecfd7212 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:46.495010 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bc5b2ecc-062a-4883-b7db-9e01ecfd7212 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:46.495686 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bc5b2ecc-062a-4883-b7db-9e01ecfd7212 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:46.496128 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bc5b2ecc-062a-4883-b7db-9e01ecfd7212 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:46.496544 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-bc5b2ecc-062a-4883-b7db-9e01ecfd7212 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:46.629837 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-bc5b2ecc-062a-4883-b7db-9e01ecfd7212 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:46.637383 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-bc5b2ecc-062a-4883-b7db-9e01ecfd7212 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1267 microversion: 2.1 time: 0.155150 Oct 14 13:13:46.637969 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 497/998] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:46 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:13:47.661044 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-3baf35dd-4b1a-480f-9151-11525566e570 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:47.661683 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-3baf35dd-4b1a-480f-9151-11525566e570 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:47.668116 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3baf35dd-4b1a-480f-9151-11525566e570 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:47.668593 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3baf35dd-4b1a-480f-9151-11525566e570 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:47.669033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3baf35dd-4b1a-480f-9151-11525566e570 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:47.669745 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3baf35dd-4b1a-480f-9151-11525566e570 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:47.670195 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3baf35dd-4b1a-480f-9151-11525566e570 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:47.670621 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-3baf35dd-4b1a-480f-9151-11525566e570 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:47.799328 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-3baf35dd-4b1a-480f-9151-11525566e570 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:47.807006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-3baf35dd-4b1a-480f-9151-11525566e570 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1267 microversion: 2.1 time: 0.149898 Oct 14 13:13:47.807569 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 502/999] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:47 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:13:48.829288 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-fa89e053-a3f7-4c33-adda-d300269ffef4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:48.830006 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-fa89e053-a3f7-4c33-adda-d300269ffef4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:48.836467 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fa89e053-a3f7-4c33-adda-d300269ffef4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:48.836949 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fa89e053-a3f7-4c33-adda-d300269ffef4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:48.837382 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fa89e053-a3f7-4c33-adda-d300269ffef4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:48.838104 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fa89e053-a3f7-4c33-adda-d300269ffef4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:48.838558 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fa89e053-a3f7-4c33-adda-d300269ffef4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:48.838982 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-fa89e053-a3f7-4c33-adda-d300269ffef4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:49.112770 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-fa89e053-a3f7-4c33-adda-d300269ffef4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:49.121281 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-fa89e053-a3f7-4c33-adda-d300269ffef4 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1267 microversion: 2.1 time: 0.295813 Oct 14 13:13:49.121880 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 498/1000] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:48 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1267 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:13:50.143991 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-db1a893d-d7f5-4aee-acdd-99b2d3c1540f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:50.144604 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-db1a893d-d7f5-4aee-acdd-99b2d3c1540f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:50.150761 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-db1a893d-d7f5-4aee-acdd-99b2d3c1540f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:50.151249 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-db1a893d-d7f5-4aee-acdd-99b2d3c1540f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:50.151680 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-db1a893d-d7f5-4aee-acdd-99b2d3c1540f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:50.152362 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-db1a893d-d7f5-4aee-acdd-99b2d3c1540f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:50.152814 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-db1a893d-d7f5-4aee-acdd-99b2d3c1540f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:50.153236 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-db1a893d-d7f5-4aee-acdd-99b2d3c1540f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:50.285247 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-db1a893d-d7f5-4aee-acdd-99b2d3c1540f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:50.292867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-db1a893d-d7f5-4aee-acdd-99b2d3c1540f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1267 microversion: 2.1 time: 0.152783 Oct 14 13:13:50.293425 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 503/1001] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:50 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:13:51.316693 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-c72249c6-490a-4de8-820f-c95c60cfe189 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:51.317222 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-c72249c6-490a-4de8-820f-c95c60cfe189 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:51.323657 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c72249c6-490a-4de8-820f-c95c60cfe189 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:51.324138 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c72249c6-490a-4de8-820f-c95c60cfe189 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:51.324569 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c72249c6-490a-4de8-820f-c95c60cfe189 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:51.325244 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c72249c6-490a-4de8-820f-c95c60cfe189 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:51.325723 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c72249c6-490a-4de8-820f-c95c60cfe189 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:51.326140 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-c72249c6-490a-4de8-820f-c95c60cfe189 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:51.456674 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-c72249c6-490a-4de8-820f-c95c60cfe189 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:51.464279 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-c72249c6-490a-4de8-820f-c95c60cfe189 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1267 microversion: 2.1 time: 0.151503 Oct 14 13:13:51.464831 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 499/1002] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:51 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:13:52.488157 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-fd0f1d9a-adc0-405e-be57-0eaff76679c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:52.488768 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-fd0f1d9a-adc0-405e-be57-0eaff76679c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:52.491398 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell0:SELECT=2 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:52.496687 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fd0f1d9a-adc0-405e-be57-0eaff76679c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:52.497170 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fd0f1d9a-adc0-405e-be57-0eaff76679c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:52.497639 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fd0f1d9a-adc0-405e-be57-0eaff76679c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:52.498326 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fd0f1d9a-adc0-405e-be57-0eaff76679c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:52.498778 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fd0f1d9a-adc0-405e-be57-0eaff76679c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:52.499202 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fd0f1d9a-adc0-405e-be57-0eaff76679c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:52.630261 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-fd0f1d9a-adc0-405e-be57-0eaff76679c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:52.637934 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-fd0f1d9a-adc0-405e-be57-0eaff76679c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1267 microversion: 2.1 time: 0.153647 Oct 14 13:13:52.638498 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 504/1003] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:52 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:13:53.659971 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-e838253a-a7f6-4515-bfb8-8dede0e0e795 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:53.660614 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-e838253a-a7f6-4515-bfb8-8dede0e0e795 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:53.662727 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=2 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:53.663378 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell0:SELECT=6 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:13:53.669413 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e838253a-a7f6-4515-bfb8-8dede0e0e795 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:53.669919 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e838253a-a7f6-4515-bfb8-8dede0e0e795 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:53.670353 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e838253a-a7f6-4515-bfb8-8dede0e0e795 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:53.672249 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e838253a-a7f6-4515-bfb8-8dede0e0e795 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:53.672712 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e838253a-a7f6-4515-bfb8-8dede0e0e795 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:53.673138 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-e838253a-a7f6-4515-bfb8-8dede0e0e795 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:53.802124 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-e838253a-a7f6-4515-bfb8-8dede0e0e795 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:53.809769 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-e838253a-a7f6-4515-bfb8-8dede0e0e795 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1267 microversion: 2.1 time: 0.153604 Oct 14 13:13:53.810321 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 500/1004] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:53 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:13:54.833864 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-f3839019-4805-4276-a2a1-3eb9f9212f6e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:54.834411 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-f3839019-4805-4276-a2a1-3eb9f9212f6e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:54.842456 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f3839019-4805-4276-a2a1-3eb9f9212f6e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:54.843102 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f3839019-4805-4276-a2a1-3eb9f9212f6e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:54.843542 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f3839019-4805-4276-a2a1-3eb9f9212f6e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:54.844249 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f3839019-4805-4276-a2a1-3eb9f9212f6e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:54.844730 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f3839019-4805-4276-a2a1-3eb9f9212f6e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:54.845155 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-f3839019-4805-4276-a2a1-3eb9f9212f6e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:54.979721 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-f3839019-4805-4276-a2a1-3eb9f9212f6e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:54.987554 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-f3839019-4805-4276-a2a1-3eb9f9212f6e tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1267 microversion: 2.1 time: 0.158675 Oct 14 13:13:54.988114 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 505/1005] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:54 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:13:56.010604 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-b672efaf-5f88-49ee-ac37-162ad6e415ae tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:56.011203 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-b672efaf-5f88-49ee-ac37-162ad6e415ae tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:56.017655 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b672efaf-5f88-49ee-ac37-162ad6e415ae tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:56.018133 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b672efaf-5f88-49ee-ac37-162ad6e415ae tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:56.018561 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b672efaf-5f88-49ee-ac37-162ad6e415ae tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:56.019240 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b672efaf-5f88-49ee-ac37-162ad6e415ae tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:56.019684 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b672efaf-5f88-49ee-ac37-162ad6e415ae tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:56.020102 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b672efaf-5f88-49ee-ac37-162ad6e415ae tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:56.150076 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-b672efaf-5f88-49ee-ac37-162ad6e415ae tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:56.158165 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-b672efaf-5f88-49ee-ac37-162ad6e415ae tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1267 microversion: 2.1 time: 0.151362 Oct 14 13:13:56.158713 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 501/1006] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:56 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:13:56.466553 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-c43908f0-6f36-43c1-8f6e-0492baa6004c req-8838015c-3068-4ed1-b9b6-31a22833625e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3451be54-b4a6-4a64-b348-d8ba998900de", "name": "network-vif-plugged", "status": "completed", "tag": "1140c70c-36e4-4444-97d6-37c05e6cc3aa"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:13:56.478710 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-c43908f0-6f36-43c1-8f6e-0492baa6004c req-8838015c-3068-4ed1-b9b6-31a22833625e service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:56.479204 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-c43908f0-6f36-43c1-8f6e-0492baa6004c req-8838015c-3068-4ed1-b9b6-31a22833625e service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:56.479638 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-c43908f0-6f36-43c1-8f6e-0492baa6004c req-8838015c-3068-4ed1-b9b6-31a22833625e service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:56.491645 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-c43908f0-6f36-43c1-8f6e-0492baa6004c req-8838015c-3068-4ed1-b9b6-31a22833625e service nova] Creating event network-vif-plugged:1140c70c-36e4-4444-97d6-37c05e6cc3aa for instance 3451be54-b4a6-4a64-b348-d8ba998900de on hv-cinder-82099 Oct 14 13:13:56.497194 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-c43908f0-6f36-43c1-8f6e-0492baa6004c req-8838015c-3068-4ed1-b9b6-31a22833625e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034081 Oct 14 13:13:56.497828 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 506/1007] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:13:57.180372 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-04d7b00b-836d-427c-8bb2-c1ccd81577d2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:57.181083 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-04d7b00b-836d-427c-8bb2-c1ccd81577d2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:57.188019 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-04d7b00b-836d-427c-8bb2-c1ccd81577d2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:57.188497 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-04d7b00b-836d-427c-8bb2-c1ccd81577d2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:57.188921 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-04d7b00b-836d-427c-8bb2-c1ccd81577d2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:57.189625 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-04d7b00b-836d-427c-8bb2-c1ccd81577d2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:57.190071 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-04d7b00b-836d-427c-8bb2-c1ccd81577d2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:57.190483 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-04d7b00b-836d-427c-8bb2-c1ccd81577d2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:57.318576 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-04d7b00b-836d-427c-8bb2-c1ccd81577d2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:57.326265 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-04d7b00b-836d-427c-8bb2-c1ccd81577d2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1267 microversion: 2.1 time: 0.149748 Oct 14 13:13:57.326829 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 502/1008] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:57 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:13:58.348876 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-fa5d411f-3839-460f-bc27-5f16638831c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:58.349615 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-fa5d411f-3839-460f-bc27-5f16638831c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:58.356352 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fa5d411f-3839-460f-bc27-5f16638831c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:58.356840 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fa5d411f-3839-460f-bc27-5f16638831c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:58.357274 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fa5d411f-3839-460f-bc27-5f16638831c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:58.357992 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fa5d411f-3839-460f-bc27-5f16638831c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:58.358974 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fa5d411f-3839-460f-bc27-5f16638831c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:58.359398 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-fa5d411f-3839-460f-bc27-5f16638831c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:58.487909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-fa5d411f-3839-460f-bc27-5f16638831c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:58.495913 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-fa5d411f-3839-460f-bc27-5f16638831c2 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1453 microversion: 2.1 time: 0.151360 Oct 14 13:13:58.496476 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 507/1009] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:58 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:13:58.517437 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-db12f7b7-7fde-4811-b4a6-a74aa2a75a6b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:13:58.518090 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-db12f7b7-7fde-4811-b4a6-a74aa2a75a6b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:13:58.524466 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db12f7b7-7fde-4811-b4a6-a74aa2a75a6b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:58.524935 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db12f7b7-7fde-4811-b4a6-a74aa2a75a6b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:58.525363 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db12f7b7-7fde-4811-b4a6-a74aa2a75a6b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:58.526070 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db12f7b7-7fde-4811-b4a6-a74aa2a75a6b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:13:58.526514 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db12f7b7-7fde-4811-b4a6-a74aa2a75a6b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:13:58.526927 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-db12f7b7-7fde-4811-b4a6-a74aa2a75a6b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:13:58.656668 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-db12f7b7-7fde-4811-b4a6-a74aa2a75a6b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:13:58.664716 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-db12f7b7-7fde-4811-b4a6-a74aa2a75a6b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1453 microversion: 2.1 time: 0.151086 Oct 14 13:13:58.665280 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 503/1010] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:13:58 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:14:00.444268 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-9ef27a3c-5c42-40ec-9c83-bea86e025621 req-7d41594e-f368-4056-a3b1-411a4bd5478e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3451be54-b4a6-4a64-b348-d8ba998900de", "tag": "1140c70c-36e4-4444-97d6-37c05e6cc3aa"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:14:00.454626 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-9ef27a3c-5c42-40ec-9c83-bea86e025621 req-7d41594e-f368-4056-a3b1-411a4bd5478e service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:14:00.455105 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-9ef27a3c-5c42-40ec-9c83-bea86e025621 req-7d41594e-f368-4056-a3b1-411a4bd5478e service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:14:00.455545 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-9ef27a3c-5c42-40ec-9c83-bea86e025621 req-7d41594e-f368-4056-a3b1-411a4bd5478e service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:14:00.466499 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-9ef27a3c-5c42-40ec-9c83-bea86e025621 req-7d41594e-f368-4056-a3b1-411a4bd5478e service nova] Creating event network-changed:1140c70c-36e4-4444-97d6-37c05e6cc3aa for instance 3451be54-b4a6-4a64-b348-d8ba998900de on hv-cinder-82099 Oct 14 13:14:00.471401 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-9ef27a3c-5c42-40ec-9c83-bea86e025621 req-7d41594e-f368-4056-a3b1-411a4bd5478e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030875 Oct 14 13:14:00.472312 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 508/1011] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:15:36.450144 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:36.451215 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG dbcounter [-] [118869] Writing DB stats nova_cell1:SELECT=52 {{(pid=118869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:36.452562 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_api:SELECT=22 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:36.453218 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 14 13:15:36.453218 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Fri Oct 14 13:15:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de (ip 10.222.0.47) !!! Oct 14 13:15:36.453667 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG dbcounter [-] [118868] Writing DB stats nova_cell1:SELECT=46 {{(pid=118868) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 14 13:15:36.455900 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 14 13:15:36.455900 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Fri Oct 14 13:15:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Oct 14 13:15:36.455900 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 14 13:15:36.455900 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Fri Oct 14 13:15:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.47) !!! Oct 14 13:15:36.458001 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-3edfeb4f-bab7-4819-bcc3-9dda59582d21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:15:36.459343 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-3edfeb4f-bab7-4819-bcc3-9dda59582d21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:15:36.461173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-965dbc6e-961f-4c5c-b1e4-9cbaaf2dd816 req-21d46b3c-5453-4d50-8592-2569b3106728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3451be54-b4a6-4a64-b348-d8ba998900de", "tag": "1140c70c-36e4-4444-97d6-37c05e6cc3aa"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:15:36.467137 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3edfeb4f-bab7-4819-bcc3-9dda59582d21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:36.467624 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3edfeb4f-bab7-4819-bcc3-9dda59582d21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:36.468056 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3edfeb4f-bab7-4819-bcc3-9dda59582d21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:36.468757 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3edfeb4f-bab7-4819-bcc3-9dda59582d21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:36.469396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3edfeb4f-bab7-4819-bcc3-9dda59582d21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:36.470011 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-3edfeb4f-bab7-4819-bcc3-9dda59582d21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:36.483864 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-965dbc6e-961f-4c5c-b1e4-9cbaaf2dd816 req-21d46b3c-5453-4d50-8592-2569b3106728 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:36.484721 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-965dbc6e-961f-4c5c-b1e4-9cbaaf2dd816 req-21d46b3c-5453-4d50-8592-2569b3106728 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:36.485366 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-965dbc6e-961f-4c5c-b1e4-9cbaaf2dd816 req-21d46b3c-5453-4d50-8592-2569b3106728 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:36.500152 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-965dbc6e-961f-4c5c-b1e4-9cbaaf2dd816 req-21d46b3c-5453-4d50-8592-2569b3106728 service nova] Creating event network-changed:1140c70c-36e4-4444-97d6-37c05e6cc3aa for instance 3451be54-b4a6-4a64-b348-d8ba998900de on hv-cinder-82099 Oct 14 13:15:36.505319 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-965dbc6e-961f-4c5c-b1e4-9cbaaf2dd816 req-21d46b3c-5453-4d50-8592-2569b3106728 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054701 Oct 14 13:15:36.506618 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 509/1012] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 14 13:15:36.510733 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-3edfeb4f-bab7-4819-bcc3-9dda59582d21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Going to try to terminate instance {{(pid=118869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:15:36.593134 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-3edfeb4f-bab7-4819-bcc3-9dda59582d21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 204 len: 0 microversion: 2.1 time: 0.144814 Oct 14 13:15:36.593967 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 504/1013] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:15:36 2022] DELETE /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:15:36.603262 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-04b11f67-3978-40d4-84e0-51427ed1eaad tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:15:36.604347 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-04b11f67-3978-40d4-84e0-51427ed1eaad tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:15:36.611125 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04b11f67-3978-40d4-84e0-51427ed1eaad tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:36.611748 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04b11f67-3978-40d4-84e0-51427ed1eaad tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:36.612303 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04b11f67-3978-40d4-84e0-51427ed1eaad tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:36.613223 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04b11f67-3978-40d4-84e0-51427ed1eaad tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:36.613699 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04b11f67-3978-40d4-84e0-51427ed1eaad tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:36.614132 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-04b11f67-3978-40d4-84e0-51427ed1eaad tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:36.801006 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-04b11f67-3978-40d4-84e0-51427ed1eaad tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:15:36.809052 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-04b11f67-3978-40d4-84e0-51427ed1eaad tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1578 microversion: 2.1 time: 0.210549 Oct 14 13:15:36.809760 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 510/1014] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:15:36 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1578 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:15:37.833465 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-07f6bf03-fa90-4375-ae80-d34a8409b821 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:15:37.834716 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-07f6bf03-fa90-4375-ae80-d34a8409b821 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:15:37.841968 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07f6bf03-fa90-4375-ae80-d34a8409b821 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:37.842453 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07f6bf03-fa90-4375-ae80-d34a8409b821 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:37.842894 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07f6bf03-fa90-4375-ae80-d34a8409b821 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:37.843590 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07f6bf03-fa90-4375-ae80-d34a8409b821 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:37.844039 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07f6bf03-fa90-4375-ae80-d34a8409b821 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:37.844494 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-07f6bf03-fa90-4375-ae80-d34a8409b821 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:38.027778 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-07f6bf03-fa90-4375-ae80-d34a8409b821 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:15:38.035566 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-07f6bf03-fa90-4375-ae80-d34a8409b821 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1578 microversion: 2.1 time: 0.206896 Oct 14 13:15:38.036126 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 505/1015] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:15:37 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1578 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:15:38.594058 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-bf8a5d6f-b7ee-48f3-b95f-f5a86c5adcc9 req-f264130f-9dbc-4b61-bcdd-11b0f6f3f9ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3451be54-b4a6-4a64-b348-d8ba998900de", "name": "network-vif-deleted", "tag": "1140c70c-36e4-4444-97d6-37c05e6cc3aa"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:15:38.604091 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-bf8a5d6f-b7ee-48f3-b95f-f5a86c5adcc9 req-f264130f-9dbc-4b61-bcdd-11b0f6f3f9ae service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:38.604567 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-bf8a5d6f-b7ee-48f3-b95f-f5a86c5adcc9 req-f264130f-9dbc-4b61-bcdd-11b0f6f3f9ae service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:38.604995 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-bf8a5d6f-b7ee-48f3-b95f-f5a86c5adcc9 req-f264130f-9dbc-4b61-bcdd-11b0f6f3f9ae service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:38.619056 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-bf8a5d6f-b7ee-48f3-b95f-f5a86c5adcc9 req-f264130f-9dbc-4b61-bcdd-11b0f6f3f9ae service nova] Creating event network-vif-deleted:1140c70c-36e4-4444-97d6-37c05e6cc3aa for instance 3451be54-b4a6-4a64-b348-d8ba998900de on hv-cinder-82099 Oct 14 13:15:38.623680 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-bf8a5d6f-b7ee-48f3-b95f-f5a86c5adcc9 req-f264130f-9dbc-4b61-bcdd-11b0f6f3f9ae service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089836 Oct 14 13:15:38.624267 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 511/1016] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:15:39.059215 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-18b7d3fd-4552-4ddc-9425-c72151dc9a21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:15:39.059746 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-18b7d3fd-4552-4ddc-9425-c72151dc9a21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:15:39.066165 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-18b7d3fd-4552-4ddc-9425-c72151dc9a21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:39.066651 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-18b7d3fd-4552-4ddc-9425-c72151dc9a21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:39.067093 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-18b7d3fd-4552-4ddc-9425-c72151dc9a21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:39.067803 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-18b7d3fd-4552-4ddc-9425-c72151dc9a21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:39.068789 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-18b7d3fd-4552-4ddc-9425-c72151dc9a21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:39.069220 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-18b7d3fd-4552-4ddc-9425-c72151dc9a21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:39.098694 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-18b7d3fd-4552-4ddc-9425-c72151dc9a21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:39.099696 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-18b7d3fd-4552-4ddc-9425-c72151dc9a21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:39.100139 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-18b7d3fd-4552-4ddc-9425-c72151dc9a21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:39.100584 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-18b7d3fd-4552-4ddc-9425-c72151dc9a21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lazy-loading 'fault' on Instance uuid 3451be54-b4a6-4a64-b348-d8ba998900de {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:15:39.143615 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-18b7d3fd-4552-4ddc-9425-c72151dc9a21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:15:39.151392 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-18b7d3fd-4552-4ddc-9425-c72151dc9a21 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 200 len: 1231 microversion: 2.1 time: 0.096239 Oct 14 13:15:39.151958 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 506/1017] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:15:39 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:15:40.175635 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2908bea8-86d1-4bba-abb1-68be6f21bc13 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:15:40.176328 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-2908bea8-86d1-4bba-abb1-68be6f21bc13 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 3451be54-b4a6-4a64-b348-d8ba998900de] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:15:40.183082 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2908bea8-86d1-4bba-abb1-68be6f21bc13 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:40.183559 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2908bea8-86d1-4bba-abb1-68be6f21bc13 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:40.183989 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2908bea8-86d1-4bba-abb1-68be6f21bc13 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:40.184665 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2908bea8-86d1-4bba-abb1-68be6f21bc13 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:40.185114 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2908bea8-86d1-4bba-abb1-68be6f21bc13 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:40.185565 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-2908bea8-86d1-4bba-abb1-68be6f21bc13 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:40.198447 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-2908bea8-86d1-4bba-abb1-68be6f21bc13 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] HTTP exception thrown: Instance 3451be54-b4a6-4a64-b348-d8ba998900de could not be found. Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2908bea8-86d1-4bba-abb1-68be6f21bc13 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Request method failure captured: Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de HTTP/1.1 Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV9vLGes1jz82OvBjjUKnzUwn8Z09B3gJr5w62fHHppF5nItx3e4ySuP2Ly7DdyoctQqzUUWn6k0fkttypZAxb8jMh-Pef-GfpVg7Ur3hLBW-4ezP25gEtSYdBurd4XVW0itSKNzsPNEdgh13mRfTsbi362MV767QSj2m7M0dd2Nwaw Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: d5a0e78a09a843b1b6d2eee3ed8f7903 Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-TestVolumeBootPattern-1888630407 Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:15:40.200042 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:15:40.201844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d5a0e78a09a843b1b6d2eee3ed8f7903"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d5a0e78a09a843b1b6d2eee3ed8f7903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d5a0e78a09a843b1b6d2eee3ed8f7903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d5a0e78a09a843b1b6d2eee3ed8f7903", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:15:40.201844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-TestVolumeBootPattern-1888630407 Oct 14 13:15:40.201844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: d5a0e78a09a843b1b6d2eee3ed8f7903 Oct 14 13:15:40.201844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888630407 Oct 14 13:15:40.201844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-TestVolumeBootPattern-1888630407-project Oct 14 13:15:40.201844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:15:40.201844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:15:40.201844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 159c0ca7e417485b8ae497301a669228 Oct 14 13:15:40.201844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-TestVolumeBootPattern-1888630407-project Oct 14 13:15:40.201844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:15:40.201844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance 3451be54-b4a6-4a64-b348-d8ba998900de could not be found. Oct 14 13:15:40.201844 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '3451be54-b4a6-4a64-b348-d8ba998900de'} Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3451be54-b4a6-4a64-b348-d8ba998900de could not be found. Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:15:40.202867 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3451be54-b4a6-4a64-b348-d8ba998900de could not be found. Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3451be54-b4a6-4a64-b348-d8ba998900de could not be found. Oct 14 13:15:40.204284 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:15:40.205752 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-2908bea8-86d1-4bba-abb1-68be6f21bc13 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Returning 404 to user: Instance 3451be54-b4a6-4a64-b348-d8ba998900de could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:15:40.205752 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-2908bea8-86d1-4bba-abb1-68be6f21bc13 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de" status: 404 len: 111 microversion: 2.1 time: 0.030416 Oct 14 13:15:40.205752 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 512/1018] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:15:40 2022] GET /compute/v2.1/servers/3451be54-b4a6-4a64-b348-d8ba998900de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:15:43.248353 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-6b473687-4bbf-4950-b2db-3c1ea3b873ec tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:15:43.253561 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-cd2934d7-7707-4585-b61d-cf9da9cbd0f9 req-ed4eb22e-6ab8-4665-82c6-9a3a00fa49d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e20aba6-91ca-4787-b9dd-e2ac66f64bb1", "tag": "e0f9e62d-5a73-49b3-a2fb-730386480046"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:15:43.260657 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-6b473687-4bbf-4950-b2db-3c1ea3b873ec tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:15:43.264412 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-cd2934d7-7707-4585-b61d-cf9da9cbd0f9 req-ed4eb22e-6ab8-4665-82c6-9a3a00fa49d5 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:43.265033 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-cd2934d7-7707-4585-b61d-cf9da9cbd0f9 req-ed4eb22e-6ab8-4665-82c6-9a3a00fa49d5 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:43.265617 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-cd2934d7-7707-4585-b61d-cf9da9cbd0f9 req-ed4eb22e-6ab8-4665-82c6-9a3a00fa49d5 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:43.267523 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6b473687-4bbf-4950-b2db-3c1ea3b873ec tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:43.268085 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6b473687-4bbf-4950-b2db-3c1ea3b873ec tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:43.268615 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6b473687-4bbf-4950-b2db-3c1ea3b873ec tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:43.269392 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6b473687-4bbf-4950-b2db-3c1ea3b873ec tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:43.269942 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6b473687-4bbf-4950-b2db-3c1ea3b873ec tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:43.270379 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-6b473687-4bbf-4950-b2db-3c1ea3b873ec tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:43.277904 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-cd2934d7-7707-4585-b61d-cf9da9cbd0f9 req-ed4eb22e-6ab8-4665-82c6-9a3a00fa49d5 service nova] Creating event network-changed:e0f9e62d-5a73-49b3-a2fb-730386480046 for instance 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 on hv-cinder-82099 Oct 14 13:15:43.282991 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-cd2934d7-7707-4585-b61d-cf9da9cbd0f9 req-ed4eb22e-6ab8-4665-82c6-9a3a00fa49d5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032974 Oct 14 13:15:43.283721 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 513/1019] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:15:43.296762 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-6b473687-4bbf-4950-b2db-3c1ea3b873ec tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Going to try to terminate instance {{(pid=118869) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 14 13:15:43.378879 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-6b473687-4bbf-4950-b2db-3c1ea3b873ec tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 204 len: 0 microversion: 2.1 time: 0.133981 Oct 14 13:15:43.379633 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 507/1020] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:15:43 2022] DELETE /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 14 13:15:43.388637 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-be6f7f1b-3249-42f0-bd57-c2c6ec5555b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:15:43.389798 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-be6f7f1b-3249-42f0-bd57-c2c6ec5555b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:15:43.396694 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-be6f7f1b-3249-42f0-bd57-c2c6ec5555b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:43.397476 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-be6f7f1b-3249-42f0-bd57-c2c6ec5555b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:43.398171 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-be6f7f1b-3249-42f0-bd57-c2c6ec5555b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:43.399102 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-be6f7f1b-3249-42f0-bd57-c2c6ec5555b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:43.399783 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-be6f7f1b-3249-42f0-bd57-c2c6ec5555b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:43.400422 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-be6f7f1b-3249-42f0-bd57-c2c6ec5555b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:43.540015 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.policy [None req-be6f7f1b-3249-42f0-bd57-c2c6ec5555b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118868) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:15:43.548106 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-be6f7f1b-3249-42f0-bd57-c2c6ec5555b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1578 microversion: 2.1 time: 0.163685 Oct 14 13:15:43.548862 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 514/1021] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:15:43 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:15:44.573693 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-b1d93e49-8d11-463d-987f-3bb51184c36d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:15:44.574396 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-b1d93e49-8d11-463d-987f-3bb51184c36d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:15:44.580683 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b1d93e49-8d11-463d-987f-3bb51184c36d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:44.581813 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b1d93e49-8d11-463d-987f-3bb51184c36d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:44.582254 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b1d93e49-8d11-463d-987f-3bb51184c36d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:44.582953 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b1d93e49-8d11-463d-987f-3bb51184c36d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:44.583446 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b1d93e49-8d11-463d-987f-3bb51184c36d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:44.584418 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b1d93e49-8d11-463d-987f-3bb51184c36d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:44.788123 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-b1d93e49-8d11-463d-987f-3bb51184c36d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:15:44.797289 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-b1d93e49-8d11-463d-987f-3bb51184c36d tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1578 microversion: 2.1 time: 0.227924 Oct 14 13:15:44.797880 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 508/1022] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:15:44 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1578 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:15:45.268530 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [req-e44594c3-173d-4b99-aef2-4c860d3f0413 req-b8aa0ee9-57fd-436a-897d-c4a55849e1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e20aba6-91ca-4787-b9dd-e2ac66f64bb1", "name": "network-vif-deleted", "tag": "e0f9e62d-5a73-49b3-a2fb-730386480046"}]} {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 14 13:15:45.279385 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-e44594c3-173d-4b99-aef2-4c860d3f0413 req-b8aa0ee9-57fd-436a-897d-c4a55849e1b5 service nova] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:45.279869 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-e44594c3-173d-4b99-aef2-4c860d3f0413 req-b8aa0ee9-57fd-436a-897d-c4a55849e1b5 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:45.280306 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [req-e44594c3-173d-4b99-aef2-4c860d3f0413 req-b8aa0ee9-57fd-436a-897d-c4a55849e1b5 service nova] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:45.292975 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.compute.server_external_events [req-e44594c3-173d-4b99-aef2-4c860d3f0413 req-b8aa0ee9-57fd-436a-897d-c4a55849e1b5 service nova] Creating event network-vif-deleted:e0f9e62d-5a73-49b3-a2fb-730386480046 for instance 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 on hv-cinder-82099 Oct 14 13:15:45.297924 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [req-e44594c3-173d-4b99-aef2-4c860d3f0413 req-b8aa0ee9-57fd-436a-897d-c4a55849e1b5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033075 Oct 14 13:15:45.298511 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 515/1023] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Oct 14 13:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 14 13:15:45.821020 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-b5d6e970-4794-46f0-bbd2-54b3e40e7f8f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:15:45.821578 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-b5d6e970-4794-46f0-bbd2-54b3e40e7f8f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:15:45.828011 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b5d6e970-4794-46f0-bbd2-54b3e40e7f8f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:45.828494 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b5d6e970-4794-46f0-bbd2-54b3e40e7f8f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:45.828929 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b5d6e970-4794-46f0-bbd2-54b3e40e7f8f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:45.829649 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b5d6e970-4794-46f0-bbd2-54b3e40e7f8f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:45.830100 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b5d6e970-4794-46f0-bbd2-54b3e40e7f8f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:45.830523 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b5d6e970-4794-46f0-bbd2-54b3e40e7f8f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:45.864923 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b5d6e970-4794-46f0-bbd2-54b3e40e7f8f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:45.865402 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b5d6e970-4794-46f0-bbd2-54b3e40e7f8f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:45.865880 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-b5d6e970-4794-46f0-bbd2-54b3e40e7f8f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:45.866322 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.objects.instance [None req-b5d6e970-4794-46f0-bbd2-54b3e40e7f8f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lazy-loading 'fault' on Instance uuid 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 {{(pid=118869) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 14 13:15:45.907757 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.policy [None req-b5d6e970-4794-46f0-bbd2-54b3e40e7f8f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '159c0ca7e417485b8ae497301a669228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5a0e78a09a843b1b6d2eee3ed8f7903', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118869) authorize /opt/stack/nova/nova/policy.py:199}} Oct 14 13:15:45.915683 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-b5d6e970-4794-46f0-bbd2-54b3e40e7f8f tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 200 len: 1231 microversion: 2.1 time: 0.099461 Oct 14 13:15:45.916246 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 509/1024] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:15:45 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 14 13:15:46.940535 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ba2d25c8-3f19-43b4-a869-fecd6837f3af tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:15:46.941236 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-ba2d25c8-3f19-43b4-a869-fecd6837f3af tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:15:46.947971 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba2d25c8-3f19-43b4-a869-fecd6837f3af tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:46.948452 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba2d25c8-3f19-43b4-a869-fecd6837f3af tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:46.948883 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba2d25c8-3f19-43b4-a869-fecd6837f3af tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:46.949592 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba2d25c8-3f19-43b4-a869-fecd6837f3af tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:46.950045 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba2d25c8-3f19-43b4-a869-fecd6837f3af tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:46.950466 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-ba2d25c8-3f19-43b4-a869-fecd6837f3af tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:46.964116 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-ba2d25c8-3f19-43b4-a869-fecd6837f3af tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] HTTP exception thrown: Instance 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 could not be found. Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ba2d25c8-3f19-43b4-a869-fecd6837f3af tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Request method failure captured: Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 HTTP/1.1 Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV9vLGes1jz82OvBjjUKnzUwn8Z09B3gJr5w62fHHppF5nItx3e4ySuP2Ly7DdyoctQqzUUWn6k0fkttypZAxb8jMh-Pef-GfpVg7Ur3hLBW-4ezP25gEtSYdBurd4XVW0itSKNzsPNEdgh13mRfTsbi362MV767QSj2m7M0dd2Nwaw Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: d5a0e78a09a843b1b6d2eee3ed8f7903 Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-TestVolumeBootPattern-1888630407 Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:15:46.965788 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:15:46.967598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d5a0e78a09a843b1b6d2eee3ed8f7903"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d5a0e78a09a843b1b6d2eee3ed8f7903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d5a0e78a09a843b1b6d2eee3ed8f7903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d5a0e78a09a843b1b6d2eee3ed8f7903", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:15:46.967598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-TestVolumeBootPattern-1888630407 Oct 14 13:15:46.967598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: d5a0e78a09a843b1b6d2eee3ed8f7903 Oct 14 13:15:46.967598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888630407 Oct 14 13:15:46.967598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-TestVolumeBootPattern-1888630407-project Oct 14 13:15:46.967598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:15:46.967598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:15:46.967598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 159c0ca7e417485b8ae497301a669228 Oct 14 13:15:46.967598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-TestVolumeBootPattern-1888630407-project Oct 14 13:15:46.967598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:15:46.967598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 could not be found. Oct 14 13:15:46.967598 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': '7e20aba6-91ca-4787-b9dd-e2ac66f64bb1'} Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 could not be found. Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:15:46.968497 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 could not be found. Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 could not be found. Oct 14 13:15:46.969909 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:15:46.971192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-ba2d25c8-3f19-43b4-a869-fecd6837f3af tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Returning 404 to user: Instance 7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:15:46.971192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-ba2d25c8-3f19-43b4-a869-fecd6837f3af tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1" status: 404 len: 111 microversion: 2.1 time: 0.031481 Oct 14 13:15:46.971192 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 516/1025] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:15:46 2022] GET /compute/v2.1/servers/7e20aba6-91ca-4787-b9dd-e2ac66f64bb1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:15:47.637581 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-171c5ace-8745-46a7-bb62-970d8c4858b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:15:47.638073 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.compute.api [None req-171c5ace-8745-46a7-bb62-970d8c4858b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118869) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:15:47.644491 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-171c5ace-8745-46a7-bb62-970d8c4858b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:47.644975 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-171c5ace-8745-46a7-bb62-970d8c4858b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:47.645412 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-171c5ace-8745-46a7-bb62-970d8c4858b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:47.647572 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-171c5ace-8745-46a7-bb62-970d8c4858b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:47.648154 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-171c5ace-8745-46a7-bb62-970d8c4858b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:47.648595 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG oslo_concurrency.lockutils [None req-171c5ace-8745-46a7-bb62-970d8c4858b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118869) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:47.662147 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.wsgi [None req-171c5ace-8745-46a7-bb62-970d8c4858b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] HTTP exception thrown: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-171c5ace-8745-46a7-bb62-970d8c4858b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Request method failure captured: Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: request: DELETE /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b HTTP/1.1 Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept: application/json Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Accept-Encoding: identity Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Connection: close Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Length: 0 Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Content-Type: application/json Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Host: 10.222.0.47 Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: Openstack-System-Scope: None Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: User-Agent: python-urllib3/1.26.12 Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Auth-Token: gAAAAABjSV9vLGes1jz82OvBjjUKnzUwn8Z09B3gJr5w62fHHppF5nItx3e4ySuP2Ly7DdyoctQqzUUWn6k0fkttypZAxb8jMh-Pef-GfpVg7Ur3hLBW-4ezP25gEtSYdBurd4XVW0itSKNzsPNEdgh13mRfTsbi362MV767QSj2m7M0dd2Nwaw Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Id: None Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Domain-Name: None Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Identity-Status: Confirmed Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Is-Admin-Project: True Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Id: default Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Domain-Name: Default Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Id: d5a0e78a09a843b1b6d2eee3ed8f7903 Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Project-Name: tempest-TestVolumeBootPattern-1888630407 Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Role: reader,member Oct 14 13:15:47.663776 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Roles: reader,member Oct 14 13:15:47.665502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d5a0e78a09a843b1b6d2eee3ed8f7903"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d5a0e78a09a843b1b6d2eee3ed8f7903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d5a0e78a09a843b1b6d2eee3ed8f7903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d5a0e78a09a843b1b6d2eee3ed8f7903", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:15:47.665502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant: tempest-TestVolumeBootPattern-1888630407 Oct 14 13:15:47.665502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Id: d5a0e78a09a843b1b6d2eee3ed8f7903 Oct 14 13:15:47.665502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888630407 Oct 14 13:15:47.665502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User: tempest-TestVolumeBootPattern-1888630407-project Oct 14 13:15:47.665502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Id: default Oct 14 13:15:47.665502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Domain-Name: Default Oct 14 13:15:47.665502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Id: 159c0ca7e417485b8ae497301a669228 Oct 14 13:15:47.665502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: X-User-Name: tempest-TestVolumeBootPattern-1888630407-project Oct 14 13:15:47.665502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: method: > Oct 14 13:15:47.665502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: exception: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. Oct 14 13:15:47.665502 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: action_args: {'id': 'ddac68fe-a256-4b03-9006-f69520b2973b'} Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:15:47.666509 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. Oct 14 13:15:47.668182 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: ERROR nova.api.openstack.wsgi Oct 14 13:15:47.670162 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-171c5ace-8745-46a7-bb62-970d8c4858b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Returning 404 to user: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. {{(pid=118869) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:15:47.670162 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-171c5ace-8745-46a7-bb62-970d8c4858b7 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 404 len: 111 microversion: 2.1 time: 0.031554 Oct 14 13:15:47.670162 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 510/1026] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Oct 14 13:15:47 2022] DELETE /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:15:47.674166 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-21955506-f071-488e-8c24-52574ca0f07b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '>' {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:15:47.674782 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.compute.api [None req-21955506-f071-488e-8c24-52574ca0f07b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] [instance: ddac68fe-a256-4b03-9006-f69520b2973b] Fetching instance by UUID {{(pid=118868) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 14 13:15:47.680709 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21955506-f071-488e-8c24-52574ca0f07b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:47.681194 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21955506-f071-488e-8c24-52574ca0f07b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:47.681668 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21955506-f071-488e-8c24-52574ca0f07b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:47.682363 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21955506-f071-488e-8c24-52574ca0f07b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Acquiring lock "855abc56-36ec-427f-934f-3735e458a612" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 14 13:15:47.682817 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21955506-f071-488e-8c24-52574ca0f07b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 14 13:15:47.683247 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG oslo_concurrency.lockutils [None req-21955506-f071-488e-8c24-52574ca0f07b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Lock "855abc56-36ec-427f-934f-3735e458a612" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118868) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 14 13:15:47.696842 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.wsgi [None req-21955506-f071-488e-8c24-52574ca0f07b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] HTTP exception thrown: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-21955506-f071-488e-8c24-52574ca0f07b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Request method failure captured: Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: request: GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b HTTP/1.1 Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept: application/json Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Accept-Encoding: identity Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Connection: close Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Length: 0 Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Content-Type: application/json Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Host: 10.222.0.47 Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: Openstack-System-Scope: None Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: User-Agent: python-urllib3/1.26.12 Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Auth-Token: gAAAAABjSV9vLGes1jz82OvBjjUKnzUwn8Z09B3gJr5w62fHHppF5nItx3e4ySuP2Ly7DdyoctQqzUUWn6k0fkttypZAxb8jMh-Pef-GfpVg7Ur3hLBW-4ezP25gEtSYdBurd4XVW0itSKNzsPNEdgh13mRfTsbi362MV767QSj2m7M0dd2Nwaw Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Id: None Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Domain-Name: None Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Identity-Status: Confirmed Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Is-Admin-Project: True Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Id: default Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Domain-Name: Default Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Id: d5a0e78a09a843b1b6d2eee3ed8f7903 Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Project-Name: tempest-TestVolumeBootPattern-1888630407 Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Role: reader,member Oct 14 13:15:47.698391 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Roles: reader,member Oct 14 13:15:47.700118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d5a0e78a09a843b1b6d2eee3ed8f7903"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/d5a0e78a09a843b1b6d2eee3ed8f7903"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/d5a0e78a09a843b1b6d2eee3ed8f7903"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:8080/v1/AUTH_d5a0e78a09a843b1b6d2eee3ed8f7903", "adminURL": "http://10.222.0.47:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}] Oct 14 13:15:47.700118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant: tempest-TestVolumeBootPattern-1888630407 Oct 14 13:15:47.700118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Id: d5a0e78a09a843b1b6d2eee3ed8f7903 Oct 14 13:15:47.700118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-Tenant-Name: tempest-TestVolumeBootPattern-1888630407 Oct 14 13:15:47.700118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User: tempest-TestVolumeBootPattern-1888630407-project Oct 14 13:15:47.700118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Id: default Oct 14 13:15:47.700118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Domain-Name: Default Oct 14 13:15:47.700118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Id: 159c0ca7e417485b8ae497301a669228 Oct 14 13:15:47.700118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: X-User-Name: tempest-TestVolumeBootPattern-1888630407-project Oct 14 13:15:47.700118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: method: > Oct 14 13:15:47.700118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: exception: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. Oct 14 13:15:47.700118 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: action_args: {'id': 'ddac68fe-a256-4b03-9006-f69520b2973b'} Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: {{(pid=118868) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 14 13:15:47.701173 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. Oct 14 13:15:47.702938 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: ERROR nova.api.openstack.wsgi Oct 14 13:15:47.704387 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: DEBUG nova.api.openstack.wsgi [None req-21955506-f071-488e-8c24-52574ca0f07b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Returning 404 to user: Instance ddac68fe-a256-4b03-9006-f69520b2973b could not be found. {{(pid=118868) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 14 13:15:47.704387 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: INFO nova.api.openstack.requestlog [None req-21955506-f071-488e-8c24-52574ca0f07b tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b" status: 404 len: 111 microversion: 2.1 time: 0.029418 Oct 14 13:15:47.704387 dv-cinder-820994-7-iscsi devstack@n-api.service[118868]: [pid: 118868|app: 0|req: 517/1027] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Oct 14 13:15:47 2022] GET /compute/v2.1/servers/ddac68fe-a256-4b03-9006-f69520b2973b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 14 13:15:48.997777 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: DEBUG nova.api.openstack.wsgi [None req-ebbd1b2d-69c3-442e-b1bf-fbee39836d66 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] Calling method '.version_select at 0x7fbb818e6670>' {{(pid=118869) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 14 13:15:49.021763 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: INFO nova.api.openstack.requestlog [None req-ebbd1b2d-69c3-442e-b1bf-fbee39836d66 tempest-TestVolumeBootPattern-1888630407 tempest-TestVolumeBootPattern-1888630407-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1372720141" status: 202 len: 0 microversion: 2.1 time: 0.027216 Oct 14 13:15:49.022426 dv-cinder-820994-7-iscsi devstack@n-api.service[118869]: [pid: 118869|app: 0|req: 511/1028] 10.222.0.47 () {58 vars in 1263 bytes} [Fri Oct 14 13:15:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1372720141 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)